Helping comScore Process “A Fair Amount of Data”
We were incredibly privileged to welcome Mike Brown, CTO of comScore, as a guest speaker at our recent 2014 kickoff meeting.
Mike Brown is a long time Syncsort friend. He related to us his history at comScore, starting with his first encounter with Syncsort, back in 2000. He’d noticed that his data had started growing and he figured he’d be better off keeping that data sorted. He purchased his initial 4 licenses and was a happy camper: “It just worked. I never had to talk to support. And I kept throwing more data at it and the product scaled just fine”.
I think it’s fair to say that our relationship has deepened considerably since then.
comScore was an early Hadoop adopter and Mike was very supportive of our research and prototyping with the new technology in early 2011. Mike presented a use case from a recent effort with Syncsort
DMX and Hadoop at a Big Data Meetup in September that demonstrates the impressive results with he got processing huge volumes of data.
And last week, Mike Brown was here to tell everyone just how those efforts are paying off.
He cited some pretty impressive statistics. comScore processes “a fair amount of data”, as Mike likes to put it. They are up to trillions of records, which Mike said go through the Syncsort engine 4 times a day!
Mike revealed that Syncsort’s DMX is an “enabler” that allows comScore to get their data into Hadoop: “we have 100+ applications running in Syncsort today”.
The most recent success story in the making is comScore’s participation in Beta testing an upcoming release of DMX-h. “We are now testing with DMX Hadoop products and observed up to 20% performance improvement during initial testing without having to change one line of code.” During this beta, Mike has raised a support ticket with us─ his first in 14 years!
We were enormously proud to hear how Syncsort contributes to comScore’s success. Someone in the audience asked Mike what his job would be like if Syncsort didn’t exist: “Oh my gosh. A lot slower and a lot bigger. There are other solutions out there that I could use, but you guys have the best product in terms of capacity and ability to scale.”
Read our Case Study on how Syncsort DMX helped comScore achieve a 500% improvement in Data Integration throughput.