Decodable is a relatively new, over-a-year-and-a-half-old-company focussed on making it easier for developers and data engineers to take advantage of real-time data and streaming analytics for their applications.
The future belongs to real-time data, but at this point the market is at an early stage where tools are still evolving and maturing.
In this episode of TFiR Let’s Talk, Swapnil Bhartiya sits down with Eric Sammer, Founder and CEO of Decodable, to introduce us to the company and discuss the key trends in adoption of streaming and stream processing. He goes on to discuss the maturity of the tools and the importance of open source projects. Sammer also shares insights into the company’s partnership with DataStax and the benefits their combined solution brings.
Key highlights from this video interview are:
- Decodable is a relatively new company founded around one and a half years ago. The founder, Sammer, has spent 12 years working in core data infrastructure and increasingly real-time systems like Apache. His focus is now on stream processing. He goes on to discuss the challenges of stream processing and why that is now his goal.
- Streaming data is still in the early stages of maturity and is somewhat happening in pieces, according to Sammer. He goes on to detail the key drivers of stream processing and data processing for analytics so companies can train their models on better data. He explains that the end of analytics is usually nowadays a microservice making decisions in real time, moving away from human decision making.
- Sammer feels that open source projects like Apache Flink and Kafka Streams have for the large part solved the scale and latency portions of real-time analytics. However, ease of use, developer experience, and enterprise readiness still remain largely unsolved. He discusses the areas where technology is less mature, explaining that they are the areas Decodable focuses on.
- Sammer believes the strengths of open source technologies lie with scale and performance characteristics but can be challenging for the operational experience and for enterprise class features and that is why commercial companies are incentivized to close that gap. He discusses the challenges of the skills gap and how Decodable is trying to solve these problems.
- Decodable’s core values shape the company’s contributions to open source projects. Sammer discusses the importance of a healthy community in terms of quality of contributions and diversity of contributors. He explains how the readiness of open source projects is driving commercial products nowadays and the value that brings.
- Sammer discusses details about Decodable’s recent announcement about their partnership with DataStax explaining that Decodable can tap into DataStax’s community to add in their processing capabilities, which Sammer feels enables them to offer a more complete solution. He discusses the combined solution and what they are working on.
- Real-time data while it presents many opportunities also comes with a number of challenges. Sammer believes the macro barriers to streaming lie with complexity and the skill gap and that running in languages people are already familiar with what is going to be key to solving these problems. He explains that the analytics systems such as OLTP have always been real time but that now there is a push for the analytics side of the data stack to also start to go real-time. He discusses the momentum towards purpose-built, low-latency database systems and the complexity of real time.
The summary of the show is written by Emily Nicholls.