XPage rest service - can I search without using the full text index? - rest

Xpage rest service searching is limited when searching because of full text index.
In our environment we have some rather large databases. In our grids we use xe:restService to surface data to a sencha grid framework. This works great... until you need to search the grid. The grid search works unless you get a result with a ton of data and hit the full text limit. We've raised the limit on the server to upwards of 100k only to have it crash during regular operation.
Are there any other options? I am not really sure what it would be but I though I would ask.

Related

How to use overpass api?

I am a total newbie so this may be a silly question, but I can't find any tutorials on how to query overpass api to display things on own website. Do I install it on my server or is there a code to query it in the script?
What I want to achieve is to have a searchbar on one page to search for tags, and that would display one random point with that tag on the other page with a leaflet map.
But I am struggling to even display any points on it. Would it be actually better to have a local geojson file with set list of points in one town if I want to limit them to just this town anyway?
I will be grateful for any help, it's a first time I am doing something like this and it horribly stresses me out
You can visually run and try overpass queries using http://overpass-turbo.eu/.
In order to unload the overpass server, it would be a good idea to fetch the data once (and update regularly) and host them on your own server (also pay attention to the terms of use of the specific APIs, they might limit the number of requests per hour or prohibit using the for autocomplete).
To query the server from an application, GET from https://overpass-api.de/api/interpreter?data=, followed by your request (the same you would type into overpass turbo, just without line breaks).
It is also possible to host an overpass instance on your own.
If you need to learn the Overpass Query Syntax first, you can read the docs.

Get a REST/cURL representation of Kibana 5.6 search result

I've just made a Kibana query using its web interface. The query has a WHERE-like part (source:*blah2.log), and a SELECT-like part (showing only 3 fields of each match).
Naturally, Kibana fetches these items by making a REST request to ElasticSearch, which I would like to use programmatically.
How to I get the Kibana search query as in cURL / other HTTP format?
PS - I actually asked this two years ago (Representing a Kibana query in a REST, curl form), but the interface has changed and the new Kibana lacks the good old caret that opened the menu featuring that option.
There is a little arrow between the overview graph on the top and the table containing the results of your query. When you click this arrow the graph representation changes to some kind of debug view where you can either inspect the results or also see both, the request and response of the elasticsearch query.
So, if you want to get the request used for your specific query, just use the according view. But keep in mind that this request contains a bit more than you usually need, because it adds
a time range which is selected implicitly in kibana
some highlighting rules that you probably don't need
an aggregation which is used for displaying the overview chart
Under the query key you find what you want (combined with the time range). If you want to restrict the keys that are returned (and thus not want the full documents), you can use the so called source filtering as described in the elasticsearch docs. In Kibana this filtering is done on the client side which is why you don't see any excludes in the request from kibana.
Under the chart on the left there is a little arrow:
Now click on it it will display a little dropdown list.
Choose request and you can see the exact request that is send to ES. You can see as well the response and other stuff.

Highmaps from sharepoint data

I've searched for a few days for examples of now to use high maps with sharepoint data. We purchased high maps because we are confident there is a way to make the maps from sharepoint data.
The goal would be either to make a map from address or lat long data OR map just on the country of the item. We are at the phase where we are about to collect data and it's not clear how the data needs to be formatted. I believe we would either pull the data from the sharepoint list via rest and JSON is SPServices and CAML query, I've created datatables and a highcgart pie wth test data in the site.
I'm not finding any good samples out there and hoping some experts will weigh in with advice or a code snippet.
General rule is that Highcharts runs in any web browser, including web controls or browser widgets in other platforms. If SharePoint has a mechanism of including a web page in some kind of frame, then it should work.
I advice to familiar with the article about preprocessing, http://www.highcharts.com/docs/working-with-data/preprocessing and getJSON() functon in jquery.
In the highmaps you can use data points defined as lat/lng.
Further information information about that:
- http://www.highcharts.com/docs/maps/latlon

Looking for a “light” gwt framework with a rich-featured grid

I'm looking for a gwt framework with a grid that can handle more than 500.000 rows and has features like filtering, sorting, basic events (click, double-click), multi selection, auto save, bulk save, etc. I was looking at sencha and smartGWT, but they seem a bit heavy.
Could you recommend anything?
tia
Have a look on PWT, we built this framework to be as lightweight as possible.
All the features that you need are almost availabe.
But to be honest, I'am not sure that you must edit 500 000 rows on a single page, A so huge amount of data will cause memory and performance issues.
You can see the TableEditor on the sample Contacts Table : http://pwt.putnami.org/#!ContactsTable
Regards.
You can use pure GWT for your app. Here is an example of a DataGrid widget:
http://samples.gwtproject.org/samples/Showcase/Showcase.html#!CwDataGrid
Note that there is no need to load all data into the browser. You can use an asynchronous data provider and offer different filtering, sorting, search, etc. options to your users. And you always show only the first 20/50/100 results to a user.

Displaying web based visualisation or graphing of data based on a postgresql database?

I am working on a web application for a client that uses a postgresql database. I want the client to be able to go to a certain area of the site where the data from the database is displayed in graph form (for example, sales figures over a 6 month period). Is there a plugin I could use for this (I don't have any experience of this, so an easy one, or one with tutorials available would be great). I had a look at BIRT, which says it has a web based option but I couldn't really figure it out. I don't want the client to have to download and go through another program, I just want them to go to a url within their site, and it's all just presented to them there and then.
Any sort of pointers in the right direction would be greatly appreciated.
Thank you.
HighCharts, at http://www.highcharts.com/, works well for this case -- I use it fairly often. It supports Ajax data feeds in JSON format, so you can write an endpoint which returns the JSON representing the data from Postgres and which gets called from a JavaScript function which creates the graphs using that data (you would place that call in a ready function).
Also, if you're using Postgres 9.3 or higher, it supports JSON natively, so you can do the JSON conversion in the SQL query itself, as opposed to post-processing the results in your Python or other backend code.
Highcharts is reasonably flexible and allows for a variety of nice-looking, functional charts and graphs. If you want to get much fanicer, d3 may be worth a look. These are some the types of graphs/charts it can do: https://github.com/mbostock/d3/wiki/Gallery
I have not used d3 myself, however.
For the scenario you described above, Highcharts seems like it would work just fine.
It's been a while, and a lot has happened since 2016. There is now ChartJS as well - http://chartjs.org/, for example, which is easier to use than HighCharts and very flexible (I've used both).
What they both don't do is dynamic data. If you want that your client decides which data he wants to watch - that part you need to write yourself.