I am using mongodb for one of my application.
We are fetching large amount of records from the db.
We are facing following issue when we fetch large number of documents from db.
aggregation result exceeds maximum document size
Any option to set this max limit?
The documentation states that:
If you do not specify the cursor option or store the results in a
collection, the aggregate command returns a single BSON document that
contains a field with the result set. As such, the command will
produce an error if the total size of the result set exceeds the BSON
Document Size limit.
Earlier versions of the aggregate command can only return a single
BSON document that contains the result set and will produce an error
if the if the total size of the result set exceeds the BSON Document
Size limit.
The maximum BSON document size is 16 megabytes.
That actually is the problem that you have now.
Related
I am using MongoDB with Next.js. What I am trying to do is, I try to add as many sub-documents as possible to so that I can reduce the lookup time when doing a find operation. However, the maximum document is 16Mb, I will create a new document and add the sub-document to a new document if the new size will exceed 16MB.
Is there a way to check the size of the document before the insertion? For example, the current size of the document is 15mb, and I have a 2mb sub-document. I see that 15+2==17 which is greater than 16. So, we will create a new document for this new sub-document.
I cannot find the answer to this seemingly basic question. The documentation says the max size for a BSON document is 16MB.
I want to know what is the max size of a query result allowed. E.g., if there are 1,000 records in a collection, and each document is 1MB, will mongodb throw an error if there are 400 documents (totaling to 400MB)?
Which is the limit of a mongodb array field?
subdocuments have a limit of 4mb-16mb(it depends of the version). Does an array has the same limits?
The only limit is the document size. Whatever Document (or ReferenceDocument) contains the array cannot exceed that size. See limits.
I'm using a mongodb capped collection which is tailable. I want to set the size of it to a maximum value as I don't want to really have the oldest records removed according to the FIFO rule.
I want the data to pesist for as long as possible whilst keeping the features of a capped collection.
Thanks
You can make the capped collection as big as you want; just set the size parameter of create_collection to a value big enough to not run out of space.
Like this:
db.create_collection('captest', capped=True, size=20000000000)
You can create the capped collection using size (in bytes), or max (maximum number of documents to keep), or both in this case:
pymongo ->
self.db.create_collection('system_health_log', capped=True, size=5242880, max=5000)
mongo shell ->
db.createCollection("system_health_log", { capped : true, size : 5242880, max : 5000 } )
See more here on Capped Collections.
I will execute a big query so i want to know what is the maximum length of a mongodb query ?
The maximum size of a document, which is what you are constructing when you create a query is 16MB. You can see that, and other limits here:
http://docs.mongodb.org/manual/reference/limits/