Bobcares

MongoDB 16mb Limit Workaround

by | Jul 13, 2023

Learn more about MongoDB 16mb Limit Workaround from our experts. Our MongoDB Support team is here to help you with your questions and concerns.

MongoDB 16mb Limit Workaround

Did you know that MongoDB has a maximum document size limit of 16MB?

Although this a sufficient for most use cases, in some scenarios that involve unbounded arrays or sub-documents it may not be enough.

Hence, we need a workaround to the issue in order to create scalable MongoDB databases.

Our experts say users usually hit the 16mb limit by storing unbounded arrays or sub-documents.

For instance, suppose we are building a social platform for posting and commenting. This involves a schema as seen below:

MongoDB 16mb Limit Workaround

Although this schema will work for most users, it will not be enough for people with a large social following. Hence, we have to overcome the 16 MB MongoDB document limitation.

We can resolve the issue by adjusting how our data is stored and fetched. This involves using the “subset pattern”. Here’s how we can refactor the schema into two collections:

MongoDB 16mb Limit Workaround schema

This solution will make sure that we do not hit the limit and that the max document size remains small.

As seen above, we cannot increase the document size in MongoDB. This is where the above workaround comes in handy.

In a way, it is a good thing that Mongo does not allow documents without an MB limit as it may lead to excessive amounts of bandwidth, which is bad for everyone.

Our experts recommend not using MongoDB as an object storage of sorts. In fact, if we want to store files, we can do it via s3 or Backblaze with a CDN over it like Bunny CDN.

Let us know in the comments if you need help working around the MongoDB 16MB.

[Need assistance with a different issue? Our team is available 24/7.]

Conclusion

In brief, our Support Techs demonstrated a workaround for the MongoDB 16 MB limit.

PREVENT YOUR SERVER FROM CRASHING!

Never again lose customers to poor server speed! Let us help you.

Our server experts will monitor & maintain your server 24/7 so that it remains lightning fast and secure.

GET STARTED

2 Comments

  1. Denisa

    Hi! I need help working around the MongoDB 16MB. I use Fiware Context Broker, which is based on MongoDB. The difficulty comes from the fact that I use the Docker images for both of them. Furthermore, I have a python script that automatically sends data to the context broker through a request.post method, therefore I have no control over the intermediate data. This data y very large, and once it gets to the context broker it cannot be posted to the database. How would I do an workaround for this?

    Reply
    • Krishna Priya

      Hello,
      Our experts are available to assist you with your concerns. We would be delighted to discuss this with you via our live chat feature. Simply click on the icon located in the bottom right corner to get started.

      Reply

Submit a Comment

Your email address will not be published. Required fields are marked *

Never again lose customers to poor
server speed! Let us help you.

Privacy Preference Center

Necessary

Necessary cookies help make a website usable by enabling basic functions like page navigation and access to secure areas of the website. The website cannot function properly without these cookies.

PHPSESSID - Preserves user session state across page requests.

gdpr[consent_types] - Used to store user consents.

gdpr[allowed_cookies] - Used to store user allowed cookies.

PHPSESSID, gdpr[consent_types], gdpr[allowed_cookies]
PHPSESSID
WHMCSpKDlPzh2chML

Statistics

Statistic cookies help website owners to understand how visitors interact with websites by collecting and reporting information anonymously.

_ga - Preserves user session state across page requests.

_gat - Used by Google Analytics to throttle request rate

_gid - Registers a unique ID that is used to generate statistical data on how you use the website.

smartlookCookie - Used to collect user device and location information of the site visitors to improve the websites User Experience.

_ga, _gat, _gid
_ga, _gat, _gid
smartlookCookie
_clck, _clsk, CLID, ANONCHK, MR, MUID, SM

Marketing

Marketing cookies are used to track visitors across websites. The intention is to display ads that are relevant and engaging for the individual user and thereby more valuable for publishers and third party advertisers.

IDE - Used by Google DoubleClick to register and report the website user's actions after viewing or clicking one of the advertiser's ads with the purpose of measuring the efficacy of an ad and to present targeted ads to the user.

test_cookie - Used to check if the user's browser supports cookies.

1P_JAR - Google cookie. These cookies are used to collect website statistics and track conversion rates.

NID - Registers a unique ID that identifies a returning user's device. The ID is used for serving ads that are most relevant to the user.

DV - Google ad personalisation

_reb2bgeo - The visitor's geographical location

_reb2bloaded - Whether or not the script loaded for the visitor

_reb2bref - The referring URL for the visit

_reb2bsessionID - The visitor's RB2B session ID

_reb2buid - The visitor's RB2B user ID

IDE, test_cookie, 1P_JAR, NID, DV, NID
IDE, test_cookie
1P_JAR, NID, DV
NID
hblid
_reb2bgeo, _reb2bloaded, _reb2bref, _reb2bsessionID, _reb2buid

Security

These are essential site cookies, used by the google reCAPTCHA. These cookies use an unique identifier to verify if a visitor is human or a bot.

SID, APISID, HSID, NID, PREF
SID, APISID, HSID, NID, PREF