Ajax query format with Elasticsearch

2017-06-17 18:47 Manganese imported from Stackoverflow

I am trying to make a post request with AJAX to my elasticsearch index. The cURL result is:

[~]$ curl -XGET 'http://localhost:9200/firebase/_search?q=song:i%20am%20in'

{"took":172,"timed_out":false,"_shards":{"total":5,"successful":5,"failed":0},"hits":{"total":2,"max_score":0.82749283,"hits":[{"_index":"firebase","_type":"song","_id":"0001","_score":0.82749283,"_source":{"song":"i am in california","song_name":"hello","song_url":"https://s3.ap-south-1.amazonaws.com/songapp-dump/media/songs/Adele_-_Hello-_i_am_in_california.mp3"}},{"_index":"firebase","_type":"song","_id":"0002","_score":0.28582606,"_source":{"song":"i must have called a thousand times","song_name":"hello","song_url":"https://s3.ap-south-1.amazonaws.com/songapp-dump/media/songs/Adele_-_Hello-_i_must_have_called_a_thousand_times.mp3"}}]}}

Browser result is:This is also working correctly. Meaning the index has been created and cURL/ GET is able to get the result.

When I am trying to have an AJAX request do the same, I am struggling with the query format probably. I am not able to figure out.

Ajax.js

$(function() {
    $('#message').keyup(function() {
        // console.log(JSON.stringify());
        var data = {
                'song': $('#message').val()
            };
        console.log(JSON.stringify(data));
        $.ajax({
            type: "POST",
            url: "http://localhost:9200/firebase/_search",
            contentType: 'application/json',
            // data: {
            //     'q': $('#message').val()
            // },
            data: JSON.stringify(data),
            success: searchSuccess,
            dataType: 'jsonp'
        });

    });

});

The console logs the following error:

Basically it's a 400 Bad Request error. I am not able to figure out if there is something wrong with my query or the way Ajax request is being created. Why am I having callback issues! Any help would be appreciated. I have scoured the web on this issue and have tried various combinations as well.

1 answer

answered 2017-06-17 18:47 styfle

Change the method to GET and dateType to json. Also the querystring requires a q parameter.

     var data = {
         'q': 'song:' + $('#message').val()
     };

     $.ajax({
        type: "GET",
        url: "http://localhost:9200/firebase/_search",
        contentType: 'application/json',
        data: JSON.stringify(data),
        success: searchSuccess,
        dataType: 'json'
    });

See also questions close to this topic

How to get text from selected value in a dropdownlist which is js based
Hello i have trouble getting the value out of a dropdownlist created with the plugin FacetWP. I have searched A LOT and tried a lot of different methods to get the text value out of that list but with no success. my latest try was:
```
var messagepop = $(".facetwp-filter .facetwp-facet-perioxeskalipsis > .fs-label-wrap > .fs-label").text();
            alert (messagepop);
```
I have no idea what else to try.. i tried siblings() find() and everything other but i was getting a blank box in the alert..any help would be appreciated!

UPDATED: problem was due to an ajax request taking place at the time. Had to place the code a few lines further down!

window is not defined angular universal third library

I am working with the library ng2-mqtt and I used it im my component like this:

 import 'ng2-mqtt/mqttws31.js';
declare var Paho: any;

Now I am getting following error:

ReferenceError: window is not defined
    at Object.<anonymous> (/Users/Picchu/Documents/em3/node_modules/ng2-mqtt/mqttws31.js:2143:4)
    at Module._compile (module.js:556:32)
    at Object.Module._extensions..js (module.js:565:10)
    at Module.load (module.js:473:32)
    at tryModuleLoad (module.js:432:12)
    at Function.Module._load (module.js:424:3)
    at Module.require (module.js:483:17)
    at require (internal/module.js:20:19)
    at Object.<anonymous> (/Users/Picchu/Documents/em3/dist/server.js:18707:18)

How can I fix this issue?

Validate Form with JavaScript (valid option selected from cbx)

HTML - this a simple html form, which I have to validate with js, please if some could help me...

<form>
<label class="ancho">Nombre</label>
<input id="name" class="bloque" type="text" placeholder="Nicolas">
<label class="ancho">Apellido</label>
<input id="surename" class="bloque" type="text" placeholder="Oyarzun">
<label class="ancho">Edad</label>
<input id="age" class="bloque" type="number" placeholder="27" min="1" max="110">
<label class="ancho">Carrera</label>
    <select id="cbxCarrera" class="bloque">
        <option id="op0">-- Seleccione una Carrera --</option>
        <option id="op1">Programacion</option>
    </select>
    <button class="bloque boton" onclick="formulario()">Enviar</button
</form>

JavaScript

<script>
    var nombre = document.getElementById("name");
    var apellido = document.getElementById("surename");
    var edad = document.getElementById("age");
    var carrera = document.getElementById("cbxCarrera");
    var opcion0 = document.getElementById("op0");
    var opcion1 = document.getElementById("op1");

    function formulario() {
        while (nombre != null || apellido != null || edad > 0) {
            if (document.getElementById("cbxCarrera").value != "0") {
                // just checking if displays
                alert("nombre: " + nombre\ "apellido: " + apellido\ "edad: " + edad\ "carrera: "
                    document.getElementById(id).optSelected);
            }
        } else {
            alert("Porfavor ingrese valores validos en los campos anteriores.");
        }
    }
</script>

how can I validate the option selected in the combobox? thanks!

Add Html.BeginForm with jQuery in MVC view

I have some info boxes that all are loaded in with Ajax calling a function in my controller and then building the HTML.

I need some edit functionality for these info boxes which will simply replace the static text with a form. I know how I would go about doing this in regular HTML but I would like to use Html.BeginForm so that I may handle it in the controller.

This is how I wanted to load in my form (it's almost the same code as the one for loading the static info boxes)

$.ajax({
    url: '@Url.Action("GetCustomerInfoById/")' + id,
    type: 'post',
    traditional: true,
    dataType: 'json',
    success: function (result) {
        $.each(result.CustomerInfo, function (index, customerInfo) {
            $('#infoBox' + customerInfo.ID).html(/* html form goes here */);
        });
    }
})

This is how I want to build my form

@using (Html.BeginForm("Index", "Customer", FormMethod.Post, new { @class = "form-horizontal" }))
{
    @model CustomerInfo

    <div class="form-group">
        @Html.TextAreaFor(m => m.InfoText, new { @class = "form-control col-12-md", @style = "max-width: none", @rows = "5" })
    </div>
    <div class="form-group">
        @Html.DropDownListFor(m => m.InfoTypeId, new SelectList(InfoTypeList, "Value", "Text"), new { @class = "form-control", @style = "max-width: none" })
    </div>
    <input type="submit" value="Gem" class="btn btn-primary" />
}

Trying to implement Fittext.js

I am trying to use jQuery on my big H1 tag so that the text in the H1 tag will stay the same when resizing my browser window.

HTML:

<script src="https://ajax.googleapis.com/ajax/libs/jquery/1.11.1/jquery.min.js"></script>
<script src="js/text.js"></script>
</head>

<body>

<div class="main">
    <section class="page" id="page1">
        <div class="test">
            <h1>exampletext</h1>

CSS:

.test h1 {
    width:100%;
    text-align:center;
    font-size:250px;
    text-transform:uppercase;
    letter-spacing:5px;
}

JS:

$( document ).ready(function() {
    $("test h1").fitText(1, { minFontSize: '20px', maxFontSize: '250px' });
});

(function( $ ){

  $.fn.fitText = function( kompressor, options ) {

    // Setup options
    var compressor = kompressor || 1,
        settings = $.extend({
          'minFontSize' : Number.NEGATIVE_INFINITY,
          'maxFontSize' : Number.POSITIVE_INFINITY
        }, options);

    return this.each(function(){

      // Store the object
      var $this = $(this);

      // Resizer() resizes items based on the object width divided by the compressor * 10
      var resizer = function () {
        $this.css('font-size', Math.max(Math.min($this.width() / (compressor*10), parseFloat(settings.maxFontSize)), parseFloat(settings.minFontSize)));
      };

      // Call once to set.
      resizer();

      // Call on resize. Opera debounces their resize by default.
      $(window).on('resize.fittext orientationchange.fittext', resizer);

    });

  };

})( jQuery );

It does not seem to work when I resize my browser window, what could I be doing wrong?

Jquery Smooth Scroll Using Offset.top

I'm attempting to create a smooth scrolling effect from a topNav to various sections on a webpage. In the code below, I've recreated the issue I'm having, which is simply I can't seem to have the scroll process animated. My links jump to the proper sections, and I've console.logged along the way to make sure the proper elements are being grabbed at the time of the 'click' but it is still not working.

Can anyone assist? Initially I thought it might have to do with the fact that instead of giving the navlinks individual IDs, I grouped them with a class name. Could that be part of my problem?

$(document).ready(function() {
	
	$('.slide').click(function() {
		
		var link = $(this).attr('href');
		
		$('html,body').animate({
			scrollTop: $(link).offset().top}, 1000);
		return false;
		
		
		
		
	});
	
	
	
});

* {
	padding: 0;
	margin: 0;
}

nav {
	width: 100%;
	height: 120px;
}

div {
	width: 100%;
	height: 500px;
}

<nav>
	<a href="#first" class="slide">Section 1</a>
	<a href="#second" class="slide">Section 2</a>
	<a href="#third" class="slide">Section 3</a>
	<a href="#fourth" class="slide">Section 4</a>
</nav>

<div>
	<a name="first">Section 1</a>
</div>

<div>
	<a name="second">Section 2</a>
</div>

<div>
	<a name="third">Section 3</a> 
</div>

<div>
	<a name="fourth">Section 4</a>
</div>

How to clear form in MVC - ajax.actionlink

I tried to clear the form controller and using ModelState.Clear(); but don't work. I want to clear the form after the form is saved to database. Is there any possibility to refresh the view and clear the form jquery.

 <td>
                    @Ajax.ActionLink("Show Post Order", "_ListPost", new { idOrder = @item.IdOrder }, new AjaxOptions()
               {
                   HttpMethod = "GET",
                   LoadingElementId = "divLoading",
                   UpdateTargetId = "divPosition",
                   InsertionMode = InsertionMode.Replace

               }, new { @class = "btn btn-primary" })
                </td>
                <td>


                    @Ajax.ActionLink("Add Answer", "_AddPost", new { idZlecenia = @item.IdZlecenia }, new AjaxOptions()
               {
                   HttpMethod = "GET",
                   LoadingElementId = "divLoadingForm",
                   UpdateTargetId = "divAddPozycje",
                   InsertionMode = InsertionMode.Replace

               }, new { @class = "btn btn-primary" })
                </td>

            </tr>
            ...
            <tr id="divAddPozycje"></tr>
        }

[HttpPost]
        [ValidateAntiForgeryToken]
        public PartialViewResult _AddPost(int idOrder, AddPositionViewModel viewModel)
        {
            var findOrder = db.Order.Find(idOrder);

            if (ModelState.IsValid)
            {

                OrderPosition position = new OrderPosition { Description = viewModel.Description };
                db.OrderPosition.Add(position);
                findOrder.OrderPositionList.Add(position);
                db.SaveChanges();
                ViewBag.Information = position;                  
            }
            Thread.Sleep(2000);
            ModelState.Clear();
            return PartialView();              
        }

Ajax and spring MVC. Can't get JSON from javascript, can only get Model Attribute

So, this is my javascript code:

$.ajax({
    url: "/kepres2Web/mvc/spatiu/update",
    type: 'GET',
    dataType: 'json',
    data: JSON.stringify(rects),
    success: function (data) {
        alert(JSON.stringify(rects));
    },
    error: function (data, status, er) {
        alert("error: " + data + " status: " + status + " er:" + er);
        alert(JSON.stringify(rects));
    }
});

rects = a list of objects like this {x: 25, y: 25, width: 100, height: 50, fill: "#00ff00", border: "#228B22", isDragging: false}

and my controller method:

 @RequestMapping(value = "/update", method = RequestMethod.POST)
public String update(@ModelAttribute("record") Spatiu spatiu,@RequestBody String deskList) {
    System.out.println(deskList);
    dao.update(spatiu);
    return null;
}

When I try to print deskList, it prints the model attribute.

Thanks.

insterAdjacentHTML can't read property of null

following error keeps reapeating... i just want explanation what is wrong here and some hint,test.json is just simple'

script.js:20 Uncaught TypeError: Cannot read property 'insertAdjacentHTML' of null at renderHTML (script.js:20) at XMLHttpRequest.ourRequest.onload (script.js:13)

javascript

var animalContainer=_('animal-info');
function _(id){

    return document.getElementById(id);

}

_('btn').addEventListener("click",function(){
    var ourRequest=new XMLHttpRequest();
ourRequest.open('GET','test.json');
    ourRequest.onload=function(){
        var ourData=JSON.parse(ourRequest.responseText);
        renderHTML(ourData);
        console.log(ourData[0]);
    };
ourRequest.send();
});

function renderHTML(data){
     animalContainer.insertAdjacentHTML('beforeend','testing 123');
}

index.php

<!DOCTYPE html>
<html>
<head>
    <title>Title</title>
</head>
<body>


    <button id ="btn">Submit</button>
<script type="text/javascript" src="script.js"></script>


<div id="animal-info"></div>
</body>
</html>

Importing big JSON into ElasticSearch gives no response

I queried my MariaDB and parsed all the data into JSON file formatted according to the documentation of the Elasticsearch bulk api here.

Json sample:

{"index": {"_index": "test", "_type": "test-type", "_id": "5"}
{"testcase": "testcase_value", "load": "load_value", "detcause": "DETAILED_CAUSE_UNKNOWN", "time": "2017-09-28T08:07:03", "br_proc": "ProcDetCause", "proc_message": "MME_CB_DEF", "cause": null, "count": 3}
{"index": {"_index": "test", "_type": "test-type", "_id": "17"}
{"testcase": "testcase_value", "load": "load_value", "detcause": "DETAILED_CAUSE_UNKNOWN", "time": "2017-09-28T08:07:03", "br_proc": "BrDetCause", "proc_message": "MME_CB_DEF", "cause": null, "count": 2}
{"index": {"_index": "test", "_type": "test-type", "_id": "20"}
{"testcase": "testcase_value", "load": "load_value", "detcause": null, "time": "2017-09-28T08:07:03", "br_proc": "BrCause", "proc_message": "MME_CB_DEF", "cause": "CAUSE_UNKNOWN", "count": 2}
{"index": {"_index": "test", "_type": "test-type", "_id": "23"}
{"testcase": "testcase_value", "load": "load_value", "detcause": null, "time": "2017-09-28T08:07:03", "br_proc": "ProcCause", "proc_message": "MME_CB_DEF", "cause": "CAUSE_UNKNOWN", "count": 1}
{"index": {"_index": "test", "_type": "test-type", "_id": "39"}
{"testcase": "testcase_value", "load": "load_value", "detcause": null, "time": "2017-09-28T08:07:03", "br_proc": "ProcCause", "proc_message": "MME_CB_DEF", "cause": "CAUSE_UNKNOWN", "count": 2}
...

When I run: curl -s -H "Content-Type: application/x-ndjson" -XPOST 'localhost:9200/_bulk' --data-binary @data.json I get no response at all. I tried to take some subset of the data (i.e. 100, 1000 lines) and those worked (I even receiver a JSON response). But as soon as I went over a million it gave no response. Currently, there are only 500 entries in the Elasticsearch database.

I also checked the elasticsearch logs and they are empty.

The file has 20 million lines and approximately 2.7 GB.

Why am I not getting any response when I post a larger JSON file? Am I doing something wrong? Is there a better way to handle bulk indexing?

How to use curl to follow a url and then login at the redirected final page and verify that login worked?

I am trying to provide a url to Curl. Curl will follow all redirects until it lands a login page. Here curl should login with the provided username and password. If the login is successful it should give a "login successfull" message otherwise "login failure". I have tried this in php but no luck. I have little experience with Curl, so any help is appreciated. Can anyone point out the problem with the below code? When I run this, I get the "Not found" error.

             <html>
             <head>
              <title>Test Login</title>
             </head>
             <body>

             TEST LOGIN :


             <?php
            $data = array(
                'username' => 'admin2',
                'password' => 'admin',
                );

                $useragent = $_SERVER['HTTP_USER_AGENT'];

                $options = array(
                        CURLOPT_RETURNTRANSFER => true,      // return web page
                        CURLOPT_HEADER         => false,     // do not return headers
                        CURLOPT_FOLLOWLOCATION => true,      // follow redirects
                        CURLOPT_USERAGENT      => $useragent, // who am i
                        CURLOPT_AUTOREFERER    => true,       // set referer on redirect
                        CURLOPT_CONNECTTIMEOUT => 9,          // timeout on connect (in seconds)
                        CURLOPT_POST           => true,       // do a regular post
                        CURLOPT_UNRESTRICTED_AUTH => true,
                        CURLOPT_POSTFIELDS     => $data, // posting the username & pass
                        // CURLOPT_COOKIEJAR      => cookie.txt, 
                        CURLOPT_TIMEOUT        => 9,          // timeout on response (in seconds)
                        CURLOPT_MAXREDIRS      => 10,         // stop after 10 redirects
                        CURLOPT_SSL_VERIFYPEER => false,     // SSL verification not required
                        CURLOPT_SSL_VERIFYHOST => false,     // SSL verification not required
                );


                    // echo $link->getAttribute('href');
                    // $link->getAttribute('href')


                    $ch = curl_init('https://xxxxxxxxxx.xxxxx.ac.uk:8101/application');
                    curl_setopt_array( $ch, $options );
                    curl_exec( $ch );

                    $httpcode = curl_getinfo($ch, CURLINFO_HTTP_CODE);
                    if (200==$httpcode) {
                        echo '  ';
                        echo '<img src="green-tick-trans.png" alt="Passed" height="15" width="15">';
                        // echo $httpcode;
                    } else {
                        echo '  ';
                        echo '<img src="red_cross.png" alt="Failed" height="15" width="15">';
                        // echo $httpcode;
                    }
                    echo '<br>';
                    echo 'Result: <br>';
                    $result = curl_exec ($ch);
                    echo 'Info: <br>';
                    $info = curl_getinfo($ch);
                    // curl_close ($ch); 

                    print_r($result);
                    print_r($info);
            ?>

             </body>
            </html>

How do I use java to simulate CURL transfer parameters?

// curl -v -S -u root:abc123456 -F'notification={"applicationId":"229396","schemaId":"229506","topicId":"98315","type":"USER"};type=application/json' "http://wy.com/" | python -mjson.tool

CloseableHttpClient client = HttpClients.createDefault();
HttpPost post = new HttpPost(url);
MultipartEntity reqEntity = new MultipartEntity(HttpMultipartMode.BROWSER_COMPATIBLE);
StringBody comment = new StringBody(param,ContentType.APPLICATION_JSON);
reqEntity.addPart("notification", comment);
post.setEntity(reqEntity);
post.addHeader("Authorization", getHeader(authString));

Above is my curl and Java code.

I have already set up notification type, but when running, there are still 400 of the error prompts:

400
Required request part 'notification' is not present

Is there anyone who can help me see where the problem is?

Permission denied while copying filebeat.yml using Dockerfile and docker-compose.yml
I have setup ELK using docker-compose in AWS linux instance. but i am not getting any example configuration for filebeat.

I tried using Dockerfile but upon running
```
docker-compose -f docker-compose.yml
```
It displays error : cannot open filebeat.yml permission denied.

Filebeat version is 5.6.3

I dont have sudo access on docker.

Please help ....thanks in advance

how to setup this simple Elasticsearch Mapping in Elasticsearch-PHP?

Given in the end of the question is an terminal command showing a simple Elasticsearch mapping. I need to set up this kind of mapping for an index using Elasticsearch-PHP. And I need to do this at the time when I am indexing the data.

I know how to index in Elasticsearch-PHP. It will be something like

for($i = 0; $i < 100; $i++) {
    $params['body'][] = [
        'index' => [
            '_index' => 'my_index',
            '_type' => 'my_type',
        ]
    ];

    $params['body'][] = [
        'my_field' => 'my_value',
        'second_field' => 'some more values'
    ];
}

$responses = $client->bulk($params);

My question is that how will I set up a Mapping, corresponding to the particular Mapping given below in the elasticsearch-PHP format (I believe it will become an associative array, but I am not sure of further details)?

This is the example ES Mapping, that I want to convert to the format used in PHP:

PUT _template/packets
{
  "template": "packets-*",
  "mappings": {
    "pcap_file": {
      "dynamic": "false",
      "properties": {
        "timestamp": {
          "type": "date"
        },
        "layers": {
          "properties": {
            "ip": {
              "properties": {
                "ip_ip_src": {
                  "type": "ip"
                },
                "ip_ip_dst": {
                  "type": "ip"
                }
              }
            }
          }
        }
      }
    }
  }
}

How to handle multi criterias search in PHP
I have a little problem with doing a filter on my website. I have a form which is present in all pages, with this form user can search for products by name and category. The code looks like this:
```
<form method = "GET" action = "{!! route('search_product') !!}">
   <input type = "text" name = "searchText"/>
   <select name="category">
    ...
   </select>
</form>
```
When user submits form I'll get an url like this: search_result.php?searchText=test&category=1

It's work fine. The problem is that on the search_result page I have another form which purpose is to enable user to narrow product list by price.
```
<form method = "GET" action="{!! route('search_product') !!}">
    <input name = "min" type = "text"/>
    <input name = "max" type ="text" />
</form>
```
By doing this The precedents parameters(searchText and category) are removed when submitting form. So how to keep them.

PS: Sorry for poor English.

Related questions

Ajax query format with Elasticsearch

1 answer

See also questions close to this topic