Big Data companies

146 views
Skip to first unread message

Alexey Kharlamov

unread,
Mar 4, 2014, 1:47:01 PM3/4/14
to silicon-bea...@googlegroups.com
Hello!

Are there Big Data startups in Australia? So far I have found 4 companies and 3 of them are large financial institutions. 

Any advise would help.

Thanks in advance

Stephen Young

unread,
Mar 4, 2014, 6:24:41 PM3/4/14
to silicon-beach-australia

We're more "complex data" than "big data", but if you mean more data than you can handle in Oracle/MySQL/SQL Server then Yes, we're a Big Data startup.

Off the top of my head Kaggle and Contexti might also fit your criteria.





--
--
You received this message because you are subscribed to the Silicon Beach Australia mailing list. Vist http://siliconbeachaustralia.org for more
 
Forum rules
1) No lurkers! It is expected that you introduce yourself.
2) No jobs postings. You can use http://siliconbeachaustralia.org/jobs
 
 
To post to this group, send email to
silicon-bea...@googlegroups.com
To unsubscribe from this group, send email to
silicon-beach-aus...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/silicon-beach-australia?hl=en?hl=en

---
You received this message because you are subscribed to the Google Groups "Silicon Beach Australia" group.
To unsubscribe from this group and stop receiving emails from it, send an email to silicon-beach-aus...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.



--
--
Stephen Young
Architect: graphbase.net
61 2 9904-5882 (AU)   61 416-000-178 (Mob)  1 415 690-8639 (US)

Tom Adams

unread,
Mar 4, 2014, 6:35:55 PM3/4/14
to silicon-bea...@googlegroups.com
I know of at least one other company dealing in large data sets, they do transport modelling. I helped them build a system for this circa 2008.

What is this for?

Tom
tom adams
e:tomjadams<at>gmail.com

David Jones

unread,
Mar 5, 2014, 1:38:10 AM3/5/14
to silicon-bea...@googlegroups.com
Quantium (acquired by Woolies)
Ambiata (NICTA spinout)

Craig Stump

unread,
Mar 5, 2014, 6:02:13 AM3/5/14
to silicon-bea...@googlegroups.com
A friend of mine runs http://engineroom.io/ - works with massive data sets for finance, seismology, government, etc.

Michael Stone

unread,
Mar 5, 2014, 10:06:40 AM3/5/14
to silicon-bea...@googlegroups.com
I'm CEO of Amethon Solutions which is headquartered in Sydney with most of our development resources based in Melbourne.

We have developed an analytics platform for mobile operators which provides insight into mobile data traffic passing through their network. Our platform is a streaming analytics solution which analyses traffic meta-data generated by network nodes such as proxies, DPIs, gateways, etc and reports data usage (upload and download), latency and subscriber numbers across a range of different dimensions e.g.
  • handset brand/model, 
  • smartphone operating system,
  • mobile apps
  • form factor (tablet, handset, console) 
Our input data is in the order of 5 to 10 billion events/rows per day (300GB to 600GB of binary files) which is also generally generated in different parts of the country (think Sydney, Melbourne and Brisbane).

One of our key features is our ability to count unique subscribers/visitors across all of the dimensions we report (handset brand/model, visited sites, mobile apps, etc) across any arbitrary date range. 

Everything was developed in-house on top of PostgreSQL with the exception of the visualisation layer (dashboarding, charts, reporting, etc) which is based on Yellowfin (another Australian company). We've looked at Hadoop and columnar databases but nothing could handle the traffic volumes and deliver near real-time reporting on a relatively small and cost-effective HW footprint...

Cheers,

Michael


On Wednesday, 5 March 2014 05:47:01 UTC+11, Alexey Kharlamov wrote:

Hamish Ogilvy

unread,
Mar 5, 2014, 6:32:47 PM3/5/14
to silicon-bea...@googlegroups.com
http://www.sajari.com

We're work on our own "personalised search" and recommendations engine. It's somewhat a cross between elasticsearch.com and gravity.com, but with lots of additional benefits, like built in document classification (naive bayes and random forests so far, neural nets in dev).

In terms of data size, the biggest we've done is the US patent database, which is pretty large (~500 million pages of text). It can be set up as a distributed set of nodes, so data size is not really an issue, but we rarely find data sets that need more than a single node. I'm in the process of putting the wikipedia data set up as a demo, even that is only 47GB, which fits in a single node... 




On Wednesday, 5 March 2014 05:47:01 UTC+11, Alexey Kharlamov wrote:

Marc Englaro

unread,
Mar 6, 2014, 4:31:30 PM3/6/14
to silicon-bea...@googlegroups.com
A friend of mine Zach Zeus runs the Australia distributor/partner for Pentaho.  (www.bizcubed.com.au)  They're not a "tech startup" per se, but are a startup services business that work with big data every day. 

Marc

On Wednesday, March 5, 2014 5:47:01 AM UTC+11, Alexey Kharlamov wrote:

Alexey Kharlamov

unread,
Mar 9, 2014, 8:23:16 AM3/9/14
to silicon-bea...@googlegroups.com
Thank you all. I am actually looking for a job in big data space. 

Tom Adams

unread,
Mar 9, 2014, 8:15:44 PM3/9/14
to silicon-bea...@googlegroups.com
Ah, cool, good luck!


--
--
You received this message because you are subscribed to the Silicon Beach Australia mailing list. Vist http://siliconbeachaustralia.org for more
 
Forum rules
1) No lurkers! It is expected that you introduce yourself.
2) No jobs postings. You can use http://siliconbeachaustralia.org/jobs
 
 
To post to this group, send email to
silicon-bea...@googlegroups.com
To unsubscribe from this group, send email to
silicon-beach-aus...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/silicon-beach-australia?hl=en?hl=en

---
You received this message because you are subscribed to the Google Groups "Silicon Beach Australia" group.
To unsubscribe from this group and stop receiving emails from it, send an email to silicon-beach-aus...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

David Jones

unread,
Mar 9, 2014, 8:32:35 PM3/9/14
to silicon-bea...@googlegroups.com
In that case, take a look at ThreatMetrix and ping me off list with your linkedin profile if your interested. The data is big but not in this way: http://www.pinterest.com/pin/101753272804937744/

Soo-Han Kim

unread,
Mar 11, 2014, 1:18:26 AM3/11/14
to silicon-bea...@googlegroups.com
Hi Alexey. I work at Contexti and we focus on building Big Data platforms for enterprise. I'll send you an email if you'd like to get in touch.

On Sunday, March 9, 2014 11:23:16 PM UTC+11, Alexey Kharlamov wrote:
Reply all
Reply to author
Forward
0 new messages