Trulia is the fastest growing online real estate resource. They use Cascading as part of their main data processing pipeline, providing an easy and higher-level abstraction for running multiple MapReduce jobs. See the full case study here
Category Archives: News
New Case Study Posted – TeleNav
TeleNav used Cascading to build a sophisticated machine learning framework that supports the company’s award-winning GPS navigation and mobile workforce management service. See the full case study here.
New Case Study Posted – Scale Unlimited
Scale Unlimited uses Cascading to provide efficient, reliable and scalable workflow systems for big data processing. See the full case study here.
Concurrent, Inc. featured in GigaOM article
The article highlights Concurrent’s seed round of funding and describes current and future plans of the company. Read the full article here.
New Case Study Posted – Etsy
Etsy is using Cascading to provide advanced features on their community and marketplace sites. See the full case study here.
New Case Study Posted – Ion Flux
Ion Flux is using Cascading and Amazon Elastic MapReduce to analyze DNA sequence data. See the full case study on AWS here: http://aws.amazon.com/solutions/case-studies/ion-flux/
Concurrent is Hiring
We’re hiring Java and Web developers to take lead positions on our product team. See more here http://www.concurrentinc.com/careers/
Cascading 1.2 Released
We are happy to announce that Cascading 1.2 is now publicly available for download.
This release features many performance and usability enhancements while remaining backwards compatible with 1.0 and 1.1.
Specifically:
- Performance optimizations during grouping (StreamComparator)
- Composable map-side partial aggregations (AggregateBy)
- Native Riffle support for non-Cascading (or nested iterative Cascading) processes (ProcessFlow and Riffle)
For a detailed list of changes see:
CHANGES.txt
We are also happy to announce that Cascading and its extensions have their own Maven/Ivy Jar repository,Conjars. Conjars is a public repository, any developer wishing to publish Cascading libraries and extensions can register their public key and push artifacts. Conjars is a simple fork of the Clojars repo code.
Along with this release are a number of extensions created by the Cascading user community.
Among these extension are:
- Cascading.Avro – Cascading Scheme for the Apache Avro data serialization format.
- Cascading.Memcached – Integration with Memcached, Membase, and ElasticSearch.
- Bixo – a web mining toolkit
- DBMigrate – a tool for migrating data to/from RDBMSs into Hadoop
- Apache HBase, Amazon SimpleDB, and JDBC integration
- JRuby and Clojure based scripting languages for Cascading
- Cascalog – a robust interactive extensible query language
This release will run against 0.19.x, and 0.20.x. Including Amazon Elastic MapReduce.
BigDataCamp 2010 – Videos Now Online
BigDataCamp 2010 was a huge success this year with well over 250 registrants in attendance, making this un-conference nearly the same size as the first Hadoop Summit in 2008.
All of the BigDataCamp workshop videos are now online. Specifically our founder, Chris K Wensel, presented on Cascading. Check it out if you missed it live.
Cascading 1.1.0 Now Available
We are happy to announce that Cascading 1.1.0 is now publicly available for download.
This release features many performance and usability enhancements while remaining backwards compatible with 1.0.
Specifically:
- Performance optimizations with all join types
- Numerous job planner optimizations
- Dynamic optimizations when running in Amazon Elastic MapReduce and S3
- API usability improvements
- Support for TSV, CSV, and custom delimited text files
- Support for manipulating and serializing non-Comparable custom Java types
- Debug levels supported by the job planner
For a detailed list of changes see:
CHANGES.txt
Along with this release are a number of extensions created by the Cascading user community.
Among these extension are:
- Bixo – a data mining toolkit
- DBMigrate – a tool for migrating data to/from RDBMSs into Hadoop
- Apache HBase, Amazon SimpleDB, and JDBC integration
- JRuby and Clojure based scripting languages for Cascading
- Cascalog – a robust interactive extensible query language
This release will run against Hadoop 0.18.3, 0.19.x, and 0.20.x. Including Amazon Elastic MapReduce.
Note the tests will not compile or run against Hadoop 0.18.3 due to package changes since that version.