I am new in Azure and I am trying to implement multishard query using Elastic Scale and Entity Framework. Unfortunately I am not able to find any example solutions or good practises to achieve that target. Can anyone help me in this issue? I would be very grateful for some materials to study or hints. Thank you in advance.
Thanks for your question on multi-shard queries with Elastic Scale and EF. Currently, a straight-forward integration like the one you probably saw for data-dependent routing is not available for multi-shard queries. This is an area we are currently investing in, though. Please contact me directly over email at torsteng(at)microsoft(dot)com and we can discuss whether your use case is a good fit and we can get you unblocked.
Thanks,
Torsten
Update for 2015, Having come across similar requirements, I contacted Torsten to see if the situation has changed, kindly he got back to me.
Hi Matt,
If your cross-db querying scenario with EF is limited to read-only access on >the shards, I’d suggest to take a look at Elastic Query for SQL DB – currently >in preview. The best entry points are probably the following documents:
Overview: https://azure.microsoft.com/enus/documentation/articles/sql-database-elastic-query-overview/
Step-by-step tutorial: https://azure.microsoft.com/en-us/documentation/articles/sql-database-elastic-query-getting-started/
With Elastic Query set up, you can point an EF DbContext to the external tables >you have defined using the Elastic Query DDL. That DbContext can then be used >for everything that requires cross-db querying. This is a somewhat intricate >mix between code-first and db-first. But, it should get you off the ground.
The instructions seem simple enough, but do involve setting up another database (at the moment premium) in azure. Hope that helps.
Coming back to the thread since now the sample for using elastic database tools (previously known as Elastic Scale) is now available with EF here.
Hope this helps!
Thanks
Silvia Doomra
Related
I am trying to find out if it is possible to use EF Core (5) to query an Azure Databricks DB. Unfortunately I'm finding nearly no information about it at all.
Does anybody know of a database provider capable to do that? Or is this possible with a common built in provider?
I found an article showing how to access Spark data with EF6 using System.Data.CData.SparkSQL, but that doesn't seem to be exactly what I was looking for. :(
Thank you,
cyberblast
We start buliding an application like Tinder but not exactly the same :) We want to make a Rest service with API for Redis database to get the best performance for multiple queries going from client app. Which framework we can use? Which can offer the best performace with lowest latency?
Programming language is irrelevant for us. We will be appriciated if someone can give us advice. We must use the best technology.
Best regards for all of You :)
Better go with the Oracle database compared to the Redis database,
because in future it will become an problem for your code
Redis with your source code will be always tightly coupled very much
compared to other databases.also in redis they are not providing much
support for the customers as compared to the oracle database.
The information availability for the redis database is very lower and
oracle is pretty higher and convenient and easy to use it.
The one best thing it will give best performance from db compared to
other db .redis db much more milliseconds faster response time.
but anyway i will provide some link that will help you.
Redis DB Documentaion
Redis DB Discussions in Google groups
I started working on a small POC and decided to give Sails.js a try :)
Part of the POC we wanted to use DynamoDB since the project will eventually involve high scalability and we're not looking to hire full-time MongoDB expert at this point.
We used the module: https://github.com/gadelkareem/sails-dynamodb
Problem is there is no documentation and the module does not even work...
It seems the sails ORM is not ideal for DynamoDB and requires writing custom DB services. Does anyone have experience with this?
I was very excited to come across Sails but if it won't let us play nice with DynamoDB then it might very well be out as an option to us....
Anyone have experience with this or maybe something I'm missing?
One of the important plus of vogels is excellent documentation.
Sails-dynamodb adapter based on the vogels, but not all features are implemented in sails-dynamodb adapter. For example, vogels has Expression Filters.
Vogels able to create tables. Adapter can't. An adapter needs duplication table schema in sails files and dynamodb shell.
Vogels has some own types, such as uuid type, StringSet, NumberSet, TimeUUID. (Adapter can use it too, if includes Vogels and Joi lib)
Vogels and adapter have the same query (create, update, delete, find) capabilities.
Adapter allows without changing the code switch to another data base. Adapter encapsulates establishment of connection to database.
Conclusion - for most purposes this adapter is suitable for the work and do not need to work directly with the Vogels
Sails comes loaded with an ORM called "Waterline". There are some official waterline plugins such as mongodb, postgresql, mysql and then there are some unofficial ones created by the community. I'd assume right now that Dynamo is in the latter category since I have not come across it before. However, with that being said I would not take this experience as a reason to ditch Sails.js.
Sails.js is built with the intention that all of its components can be swapped out, this means you are not tied to a specific template engine, authentication libraries etc. and including your ORM choice.
Waterline is still being actively developed but it is sat at v0.12.1 as of writing this response. It isn't fully there yet so there will be the odd issues still around!
My recommendation? Take a look at swapping out waterline for a different ORM. Keep the flexibility Sails gives you and change out the component that doesn't meet your criteria. There are still many benefits to Sails you can utilise.
Vogels might be worth checking out: https://github.com/ryanfitz/vogels
Turning off waterline: Is there a way to disable waterline and use a different ORM in sails.js?
I'm about to implement a system which will need to receive a lot of calls per day and save them. It needs to bring information to internet users as well (something like a call center or a 911).
I've two doubts:
1) I'm between using SQL Server, MongoDB or Cassandra,
2) If it's SQL Server I'm between using and ORM like NHibernate or Entity Framework.
Any suggestions will be appreciated.
Thanks in advance. Daniel
Can't tell without more detailed requirements (e.g., volume, etc.) I'll bet any of them will "work". You should pick the one you know best, implement it, and get some data.
You don't need an ORM layer if you don't have objects, especially those with complex relationships.
Why dont you do both? For every write or update you make in cassandra, fire a jms message. The consumer of that jms message can read from cassandra and update your RDMS (mysql, oracle, etc).
It's obvious that I'm not an expert on Cassandra. So the question may sound silly.
Given an existing SQL-based project does it give any benefit or is it even possible to apply a no-SQL database(e.g. Cassandra) as an additional layer between business logic and SQL database to speed up our queries or inserts.
It's relatively new technology and I'm trying to find its place.
Cassandra will work fine, but if you don't care if you have to rebuild your data memcached will be faster.
But if you want a persistent cache, Cassandra is probably your best option -- reddit started by using Cassandra like this and is working on moving more functionality to it.
I would go with Windows Server AppFabric aka Velocity distributed cache with SQL Server, assuming you are on the .NET platform.
Scott Hanselman has a bunch of posts on AppFabric.