BSON Google Group

How to create a BSONObj in iterations? (C++)

shtetl...@gmail.com (Shmerl) — Thu, 07 Mar 2013 23:18:54 UT

It looks like the current implementation if BSONObj revolves around
immutability, and one can't even modify an existing field without
recreating the whole object. Is there a way to *add* a field without
recreating the object?
I tried to use addFields, but it asserts that the object is empty. I need

Json.parse error 。help

daben1...@gmail.com (范永东) — Mon, 04 Feb 2013 06:45:28 UT

String sql="{aggregate:\"cms_article\ ",pipeline:[{$match:{$and:
[{\"_id\":{$ne:\"\"}},{\"edito r\":{$regex:/sys/}}]
BasicDBObject bdr=(BasicDBObject)JSON.parse( sql);
there is error .
{aggregate:"cms_article",pipel ine:[{$match:{$and:
[{"_id":{$ne:""}},{"editor":{$ regex:/sys/}}]
^
at com.mongodb.util.JSONParser.pa rse(JSON.java:381)

Mutable BSON

cbise...@gmail.com (Claudio Bisegni) — Sat, 29 Dec 2012 11:16:41 UT

I have seen that in the last bson implementation that is contained on
mongodb git repo, there is a folder named mutable BSON. What is intended
for mutable? the ability to update the values for a key?
thanks in advanced?

How to explain the encode of the complex BSON document example in the BSON specification?

liupeng...@gmail.com (Peng Liu) — Wed, 19 Dec 2012 09:30:09 UT

{"BSON": ["awesome", 5.05, 1986]}
encoding:
"\x31\x00\x00\x00\x04BSON\x00\ x26\x00
\x00\x00\x020\x00\x08\x00\x00
\x00awesome\x00\x011\x00\x33\x 33\x33\x33\x33\x33
\x14\x40\x102\x00\xc2\x07\x00\ x00
\x00\x00"
How to explain it?
Thanks.

Element ordering in BSON documents

rakesh.vidyadha...@gmail.com (sptrakesh) — Wed, 12 Dec 2012 17:27:39 UT

Hello,
I do not see any mention of it in the specifications, but are two BSON
documents considered identical if they have the exact same elements
regardless of ordering of the elements? I need this to properly implement
my operator == for BSON documents.
Thanks
Rakesh

Independent C++ Library

rakesh.vidyadha...@gmail.com (sptrakesh) — Fri, 12 Oct 2012 19:45:05 UT

Hello,
[link]
This is now close to final. I may add a few more test cases to ensure that
everything works as expected (especially when using the uncommon data
types). This is part of a much larger API that we use to develop client
applications (with a focus on mobile platforms). We will be testing the

BSON size with C driver

rakesh.vidyadha...@gmail.com (sptrakesh) — Wed, 03 Oct 2012 14:44:58 UT

Hello,
I am working on a standalone BSON C++ API. At present I have a couple of
issues with my BSON serialiser, so am using the C API to generate the bson.
I do not see any functions to set the size (the first 4 bytes of the
document as per spec) of the BSON data, neither could I find anything

How to test a new driver?

colinpaulad...@gmail.com (Colin Adams) — Wed, 26 Sep 2012 10:02:52 UT

I'm probably about to write a BSON implementation for Eiffel. I'm
thinking about how to test.

Searching this group, I came upon a thread that was talking about old
test cases, and as I read it, they have been abandoned.

Storing array vs. csv string

arvind.2...@gmail.com (Arvind Satyanarayan) — Mon, 03 Sep 2012 20:30:37 UT

Hi there,
We're looking to store high dimensional vector data in MongoDB. Each vector
consists of approximately 2000 floats and we were originally storing this
as a csv string. However, we recently converted these strings to arrays but
noticed that doing so caused the physical size of the database files to

ObjectID to/from UUID/GUID

stijnsand...@gmail.com (Stijn Sanders) — Mon, 25 Jun 2012 12:12:39 UT

Having done some work both with UUID's/GUID's, and mongoDB's ObjectID's,
I would like to propose a general system to go back and forth between the
two.
There are similarities between UUID's and ObjectID's, and UUID's have 4
bytes more
and a way to provide some minimal variation and version information.

bad coding style on _BufBuilder class

cbise...@gmail.com (Claudio Bisegni) — Tue, 22 May 2012 18:33:17 UT

Hi i've partially resolve the BSON patch for let him working on arm v5(on
v6 and upper it's work. The problem is that within abc method the style of
the coding puts a bug .
I'have resolve substituting the content with: memcpy(grow(sizeof(int)), &j,
sizeof(int)); ( this has been made for "int" version)

bson c driver

cbise...@gmail.com (Claudio Bisegni) — Sun, 22 Apr 2012 20:47:06 UT

Hi,
i'm trying to use bson c driver instead cpp due to a bug in ccp version
when running on arm.
i'm trying to deserialize a bson so i used this:
bson = bson_create();
bson_init_data( bson , (char*)serializedBson);
this work but serializedBson is managed elsewhere so how can let bson will
copy the data? there is an api?

compiling bson standalone.....

cbise...@gmail.com (Claudio Bisegni) — Sat, 21 Apr 2012 16:09:50 UT

I'm trying to use the bson package standalone. i have get bson forlde and
other file front the /util/
when i compile i got error in bson-inl.h and bsonelement.h with this error:
"'struct bson::BSONElement' is incomplete" where i can find all the
definition of this object?
I want' say that if bson wan't to be a standard...the current code design

BSON on arm cpu

cbise...@gmail.com (Claudio Bisegni) — Fri, 20 Apr 2012 20:57:36 UT

Hi,
i have compiled succesfully bson cpp on arm but i have problem when i ho to
read string key. I receive the error:
terminate called after throwing an instance of 'bson::assertion'
what(): BsonAssertion id: 13111 field not found, expected type 2
Aborted
the other type seem to work. Any ints about that? where i can search to try

Forcing C++ compilation

nicoola...@gmail.com (Nicoolas) — Thu, 12 Apr 2012 14:00:23 UT

Hello,

It might be a SCONS question, please tell me if it is not really bson
relevant.

I am currently struggling to compile the C driver :
- using a C++ compiler
- on a Windows XP machine
- if possible with the Visual Studio 2010 C++ compiler
- via scons _or_ make, whichever is the easiest

Independant BSON C library

nicoola...@gmail.com (Nicoolas) — Fri, 23 Mar 2012 16:44:25 UT

Hello,

I wish to implement BSON to serialize data on a device only
programmable in C (without using MongoDB at all)

I downloaded the MongoDB C driver and compiled the two libraries
libbson and libmongoc.

I was hoping to build the BSON test file (bson_test.c) against the
bson lib only, but it seems to requires both bson and mongdb libraries

A couple suggesitons for BSON

alvaro.seg...@gmail.com (alvaro) — Sat, 17 Mar 2012 17:34:18 UT

I have some remarks about the
BSON format's arrays:

Arrays in BSON are stored as documents (objects) whose
properties are integer numbers written as text. I think that
adds unnecessary informations, as arrays have consecutive
indices so that they don't need to be stored. Also, indices have

New array type proposal

cbise...@gmail.com (Claudio Bisegni) — Sat, 17 Mar 2012 07:48:43 UT

Hi, I have a proposal for a new array type to bson spec. Now array are a bson document list. Image if I need to encode hundred or thousand of same elements (also structured) the write and read need to pass to write and read of full bson document for every elements. In high performance environments will be usefull to store one time the array elements structure and then store sequentially the value of the structured data. In high energy physics experiment this situation is the rule. Keep I mind for example a sample of signal. I can have a structure of two element, double for value and integer for time. An efficient way to store this into a new array type in bson is needed. Can we discuss this upgrade? I don't want go out the standardization.

signed integer encoding

spaeth.be...@googlemail.com (Bernd Späth) — Fri, 16 Mar 2012 22:12:36 UT

Hi together,
to me the BSON-spec seems to be missing encoding information regarding both
signed integer types: int32 as well as int64.
As it even dictates byte-order in little-endian format it seemed to me you
are trying to accomplish binary-interchangablity with this spec.
If this is the case the information 32-bit signed integer is quite

Binary subtype question

cbise...@gmail.com (Claudio Bisegni) — Thu, 15 Mar 2012 17:07:02 UT

hi all,
i need to use the subtype value of bson for binary field. I have seen that
is use \00 to \06 and \80 is for user defined. I need to describe the
cogent of binary field with some custom structure that use base defined
elsewhere. For every structure i'd like to use a free subtype code. Can i

how to post a bson object using curl from a c program

jeff.archer1...@gmail.com (Jeff Archer) — Wed, 07 Mar 2012 03:59:45 UT

Hi I am new to bson.
Can someone please tell me how to post a bson object using curl from a c
program ?
My options are limited as I have to use only c for this.
Appreciate your help.
-JA

"Time to Live" or "Expire Time" type for BSON

tugrulto...@gmail.com (threedot) — Sun, 26 Feb 2012 13:39:23 UT

BSON is very excellent format specification to exchange data
semantically.

BSON will be beyond of data storage format in the future. Also It will
be used for data exchange format externally.

On-demand external replication's cost very high than internal
replication. But it is possible via lazy replication instead of on-

update key value of a BSON Object

cbise...@gmail.com (Claudio Bisegni) — Wed, 11 Jan 2012 08:17:18 UT

Hi,
there is way in BSON to update a value for a determinate key? i have
tried to append the same key with different value and obviously i got
the same key twice. i need this feature for a my project so i need to
implement it is this function is not provided.
anyone has an idea?

thanks in advanced

Sending binary data using BSON over HTTP POST

alperayde...@gmail.com (Alper) — Thu, 22 Dec 2011 22:20:18 UT

Hi,

I'm planning to send lots of binary data (several images in one
message in this case) over HTTP POST.
I know that JSON does this by encoding the binary part as Base64 and
this introduces a lot of overhead. Is BSON any better in this case?

Please explain bson encode

slash...@gmail.com (zaqi syah) — Mon, 12 Dec 2011 05:33:03 UT

{"hello":"bson"}
\x15 \x00 \x00 \x00 \x02 h e l l o \x00 \x05 \x00 \x00 \x00 b s o n \x00
\x00
I already read from this link : [link] but
stil confused.
Can anyone explain what \x15 & why start \x15?
what\x02 before "hello"?
what \x05?
why many \x00?
thanks in advance

Traversability

kohanyi.rob...@gmail.com (Kohányi Róbert) — Fri, 21 Oct 2011 09:32:09 UT

As the specification states: "BSON is designed to be traversed eas
ily."

What does "easily" refer to?

Does this mean that a document, as a *whole* (stored on disk for
example) can be easily deserialized into memory (which process, I
know, is quite easy)? Or it means that it's easy to query a document

String vs CString

kohanyi.rob...@gmail.com (Kohányi Róbert) — Wed, 19 Oct 2011 16:16:31 UT

In the specification string is defined as follows:
string ::= int32 (byte*) "\x00"
cstring ::= (byte*) "\x00"

I can understand why cstring is defined this way, however I can't see
the advantages of the trailing "\x00" in string's definition.

What is the use-case for this? Why isn't sufficient to define it as

Read BSON from file

afel...@gmail.com (Viet Nguyen) — Tue, 11 Oct 2011 04:42:41 UT

I am working with a device that runs on embedded linux and has a cgi
web server.

Because the resource is limited, I do not install a DB server, instead
I store data in separate JSON files, for instance config.json and use
JSON format for data protocol.
Handling request (GET) from browser is quite easy, because I just dump

Java BSON

kohanyi.rob...@gmail.com (Kohányi Róbert) — Mon, 03 Oct 2011 16:47:57 UT

I've created a simple Java BSON encoder/decoder implementation: I've
called it ebson (e for extensible). The project's page is here:
[link].

It is independent of MongoDB: for example, my library doesn't provide
an ObjectId implementation (however clients can plug their own

Is there a pure JavaScript impl of BSON

vic.gvo...@gmail.com (netSQL) — Wed, 21 Sep 2011 03:33:47 UT

I could not find a pure JavaScript implementation of BSON.

Help?

I plan to use BSON client side, in the browser.

Help?

Vic

Extending the supported fundamental types..

klinkenbec...@gmail.com (Klinkenbecker) — Sun, 18 Sep 2011 18:57:21 UT

I am an embedded developer looking at using BSON objects as a medium
of object exchange and storage in embedded systems.

This has a number of advantages in being able to uniformly manage
objects between heterogeneous systems.

However, for embedded applications the lack of int16 and float types

bsondump produces invalid JSON

si...@lanyrd.com (Simon Willison) — Sun, 14 Aug 2011 20:42:55 UT

Quick bug report: bsondump currently produces invalid json for any
bson file that includes date objects. For example:

{ "_id" : "4e422f07ee4375537d0002fa", "ts" :
Date( 1312960263075 ), "s" : "A string"}

The Date ( ... ) bit will choke any validating JSON parser.

Additionally, by default the bsondump tool appends a line to the end

How can I consume a .bson file produced my mongodump using Python?

si...@lanyrd.com (Simon Willison) — Sun, 14 Aug 2011 20:52:59 UT

If I dump out a collection from mongodb using the following command:

mongodump --db mydb --collection mycollection --out - > /tmp/
mycollection.bson

How can I then consume data from that file directly in to a Python
script?

I've tried using the pymongo.bson module and I've managed to use it to

JSON to BSON

shermik...@gmail.com (mike) — Thu, 07 Jul 2011 17:05:56 UT

Hi all
I have some task for wich i want to store data(not very big) in bson
and describe data in json. But could not find converter for that case.
Can anybody help me? Use pure C language.
Thanks a lot for any help.

Confusion around utf8

chris...@gmail.com (christkv) — Wed, 06 Jul 2011 13:10:48 UT

I got a question about BSON. For attribute names in a document are
they supposed to support UTF8 attribute names.

Example, is

{'客家话' : 'Hello'}

Considered a valid BSON object or should it throw an error due to the
attribute name being UTF8. The performance implications is big so I

A question from the documentation

roshin...@gmail.com (clueless_rosh) — Wed, 29 Jun 2011 18:26:19 UT

i was reading the bson documentation and came across this part :
class bson.binary.Binary(data[, subtype=OLD_BINARY_SUBTYPE])¶

Bases: str

Representation of BSON binary data.

This is necessary because we want to represent Python strings as
the BSON string type. We need to wrap binary data so we can tell the

help!! new to BSON

roshin...@gmail.com (clueless_rosh) — Wed, 29 Jun 2011 14:27:28 UT

Hey i am using pymongo and am completely new to it!

I was wondering if there is any good tutorial around. I have to create
a binary object of my pdf file and cant seem to find any proper help
online..any suggestions?

Big Decimal

chris...@gmail.com (christkv) — Wed, 29 Jun 2011 14:18:14 UT

I'm the maintainer of the mongodb driver for node.js and I'm getting
some requests around representation of values.

Right now there is a 32 bit integer, 64 bit integer and a 64 bit float
type for bson. However some people are trying to store larger numbers
(I expect scientific or something similar) that have a need for a

BSON root object with empty key

e...@anuff.com (Ed Anuff) — Thu, 23 Jun 2011 17:25:54 UT

According to the spec, it's possible to have an empty element name:

e_name ::= cstring
cstring ::= (byte*) "\x00"

I've tested this with the java implementation:

BSONObject o = new BasicBSONObject();
o.put("", new UUID(1L, 2L));
BSONEncoder enc = new BSONEncoder();
byte[] b = enc.encode(o);

BSON Example

m.schulte1...@googlemail.com (Matthias Schulte) — Thu, 09 Jun 2011 16:27:01 UT

Hey guys,

i'm having a talk about MongoDB in a context of a seminar at
university. So i'm trying to understand how JSON is translated into
BSON.

I took a look at [link] and tried to
understand the example. I can understand it mostly but one point is
going to make me crazy.

bson with mongodb

vgrkrish...@gmail.com (vgrkrishnan@gmail.com) — Wed, 01 Jun 2011 07:33:15 UT

just am usinf the mongodb, so when i go through several sites related
with mongodb, i saw "MongoDB stores documents (objects) in a format
called BSON" but actually i didn't get that.

i understand the format of data storing in mongodb like

"name": vishnu, "age": 12...

so why mongodb follow this format, what is the advantage of this bson

mongodb with bson

vgrkrish...@gmail.com (vgrkrishnan@gmail.com) — Wed, 01 Jun 2011 08:57:33 UT

just i studying the mongodb, so when i go through the sites related with
mongodb, i could see the "MongoDB stores documents (objects) in a format
called BSON <[link]>"
so actually i didn't get the clear idea of BSON . just i got, the bson have
a format that using in the mongod.ie
"name": vishnu, "age" : 22..

BSON date field error on ARM CPU

rakesh.vidyadha...@gmail.com (sptrakesh) — Sun, 22 May 2011 17:57:13 UT

Hi,

I have been successfully using BSON as the primary model for a few iOS
applications (extracted from MongoDB 1.8.1 C++ sources). I am
currently working on a BSON structure that includes multiple date
types. Everything works fine on the simulator, but crashes on the
device with an unknown function error. The following screen captures

comparing BSON and tnetstring

b...@benatkin.com (Ben Atkin) — Thu, 12 May 2011 19:58:10 UT

I just found out about tnetstring through Zed Shaw and it sounds a lot like
BSON. One difference is that it appears to only accept JSON types; that is,
there is no date type and there's no binary type.
[link]
[link]
What do you folks think of this? Does it solve a big part of the problems

Extract BSOn form mongodb

cbise...@gmail.com (Claudio Bisegni) — Mon, 02 May 2011 20:27:17 UT

Hi
i'm trying to separat bson library from mongo but if i want to get all
serialization and deserialization(bson/json) i need most of db file.
There is anyone that has made this work?

Thanks in advanced

Sample BSON Services???

yasirmt...@gmail.com (yasirmturk) — Mon, 02 May 2011 14:28:55 UT

are there any sample web APIs for BSON for people to interact with and
get hands on experience??

BSON missing top-level array definition

shane.hollo...@ieee.org (Shane Holloway) — Wed, 13 Apr 2011 20:28:02 UT

I was doing a bit of digging into and comparison of BSON with JSON,
and found a structural difference. According to section 2 of RFC 4627
that nails down the exact definition of application/json mime type, it
states the following:

A JSON text is a serialized object or array.

JSON-text = object / array

Consideration on BSon spec

cbise...@gmail.com (Claudio Bisegni) — Tue, 12 Apr 2011 17:31:39 UT

Hi all,
i'm considering to use BSon serialization into my institute project.
Iwas reading the spec of BSon and i have notice that 1.0 vers of bson
spec, in effect are very much mongo specifyc. I see field that doesn't
have sense into a serialization spec.

it' seem that in spec there are also mongo protocol specification. For

Comparing BSON with XStream / JibX

kaniska.man...@gmail.com (Kaniska) — Fri, 25 Mar 2011 23:01:05 UT

Hi,

I am trying to understand the difference between XStream and BSON.

Are they complementary to each other ?
Or is there any performance benchmark to help decide which one would
be faster for parsing xml document ?

Also how does BSON perform when compared to java based document
parsing / traversal techniques - JibX / Xmlbeans ?

Motivation for BSON (instead of DER, ITU-T X.690, ISO 8825-1)?

steffen.dett...@googlemail.com (Steffen Dettmer) — Mon, 14 Mar 2011 13:15:43 UT

Hi,

by accident I just found [link] and it seems it
defines how to encode structured data.

Why inventing BSON instead of using Distinguished Encoding Rules
([link]), where tools
exist to generate encode and decoder source code statically or