Buzzword Bashing & Database Narcs: The Future of Big Data in Boston
First of all, let’s get our terminology straight. Depending on whom you ask, “big data” is either:
A. Bullshit (Brad Feld)
B. No substitute for judgment (David Friend)
C. The marriage of corporate data with external data (Chris Lynch)
D. Data that’s growing faster than Moore’s law (Richard Dale)
After this week, my answer would be E, all of the above.
On Wednesday, we had a packed house of 300-plus attendees and a star-studded roster of speakers at our “Future of Big Data” conference. Huge thanks to our sponsors, and to our gracious hosts, the Fidelity Center for Applied Technology, for making this event possible.
In addition to the above insights—and the overarching notion that you have to go beyond the label of big data to get any real value—here are my top 10 highlights from the day, in the form of quotes (some of these might be paraphrased as I was busy moderating):
1. “Twenty years from now, the thing we call ‘big data’ will be tiny data,” said Brad Feld of Foundry Group. He implored us to look beyond the marketing hype of big data and put the buzzword in proper perspective—reminding us that Massachusetts was once home to the minicomputer revolution (with DEC, Data General, Wang, etc.), only to get passed up by PCs and the Internet.
2. “Systems know more about you than you probably want them to,” said Carbonite’s CEO, David Friend, raising the specter of privacy concerns in big data. He emphasized that his company doesn’t allow anyone access to data backed up by its customers. The whole notion of Carbonite (which adds a petabyte per week) and other backup companies reminded me that although the Web never forgets, your personal or corporate data can be lost, mishandled, or breached.
3. “The intersection of big data in the cloud and big data in the enterprise” raises issues of both privacy and security, said Burt Kaliski, CTO of Verisign. (That also touches on a definition of big data above, from Atlas Venture’s Chris Lynch.) EMC’s chief IT architect, Narayanan “KK” Krishnakumar, talked about the importance of “transparency” and “selective sharing” of information in the face of IT threats such as social engineering. What’s more, Andy Palmer (from Cloudant, Vertica, and other companies) said the biggest corporate threat is “disgruntled IT employees.”
4. “The interesting thing is what big data tells you over time.” That was Peter Stern, CEO of Bitly, on the importance of doing long-term analytics instead of just looking at snapshots. Bitly analyzes what people click on, not what they talk about (actions speak louder than words); Stern also emphasized the value of the long tail of Web traffic, rather than the spikes. Bitly estimates that it sees 1 percent of clicks on all new content.
5. “The database people have been asleep, and Oracle has been providing the narcotics,” said Andy Palmer. The big data infrastructure panel could agree on one thing: the database technologies of the past 30 years are no longer able to keep up with the world’s data demands. While ParElastic and NuoDB are creating more scalable database architectures, Hadapt is building a next-generation analytics platform, Cloudant is selling distributed database services, and Actifio is doing smarter data management (it’s also a yogurt brand, joked Brian Reagan).
6. “Big data as a service.” That’s a key area of opportunity and white space, according to Rich Levandov of Avalon Ventures. Not surprisingly, the VC panel didn’t see a “big data bubble” about to burst anytime soon. And from what I gather, neither did most of our speakers who are building companies around emerging database technologies and analytics platforms.
7. “This shit is hard.” That was Fred Lalonde, CEO of Hopper, on why he thinks a big data transformation won’t happen as fast as the Web or mobile revolution. “Big data kicked my ass for two years,” he added. What changed? Open source and cloud infrastructure bloomed, top Google developers left to join other companies, and now “you can start building a company in a completely different way.”
8. “The challenge is finding the signal” in all the noisy data, said Shareaholic CEO Jay Meattle. That dovetails with a theme from the enterprise panel as well as Stern’s talk on Bitly—namely that a key to gaining real insights is looking at some of the data, not all of the data. Shareaholic, by the way, is trying to build a more valuable social graph than Facebook, via tools and analytics for content sharing.
9. “Once the notion of privacy goes away, we can do some pretty cool things.” That was Sravish Sridhar, CEO of Kinvey. Taking the long view of what technology and society will be like in five to 10 years, he contends that people and companies will be open books from a data standpoint. And if that’s where the world is heading, look for transformations in retail, marketing, social Web, mobile, development, design, and healthcare.
10. “It’s not going to happen,” said Hardi Meybaum, CEO of GrabCAD, about the prospect of a big data tech renaissance in Boston. His argument is that companies that own the data and understand it, especially from a consumer perspective, will be the big winners. And there aren’t enough of those in Boston, he says. Let that be a challenge to the tech community.