Apache Kafka gets SQL sup­port

OpenSource For You - - Fossbytes -

Apache Kafka, the key com­po­nent in many data pipe­line ar­chi­tec­tures, is get­ting SQL sup­port. San Fran­cisco-based Con­flu­ent has re­leased an open source stream­ing SQL engine called KSQL that en­ables de­vel­op­ers with con­tin­u­ous, in­ter­ac­tive queries on Kafka.

The latest an­nounce­ment is quite im­por­tant for busi­nesses that need to re­spond to SQL queries on Apache Kafka. The same func­tion­al­ity was ear­lier lim­ited to Java or Python APIs.

KSQL pro­vides an eas­ier way to lever­age the real-time data on Kafka. Any de­vel­oper who is fa­mil­iar with SQL can read­ily use KSQL on Kafka to build so­lu­tions. The plat­form has a fa­mil­iar syn­tax struc­ture and does not re­quire mas­tery of any com­plex in­fras­truc­ture or a pro­gram­ming lan­guage. More­over, KSQL cou­pled with Kafka’s scal­able and re­li­able en­vi­ron­ment is ex­pected to add a lot of value to Kafka users.

“Un­til now, stream pro­cess­ing has re­quired com­plex in­fras­truc­ture, so­phis­ti­cated de­vel­op­ers and a se­ri­ous in­vest­ment. With KSQL, stream pro­cess­ing on Apache Kafka is avail­able through a fa­mil­iar SQL-like in­ter­face, rather than only to de­vel­op­ers who are fa­mil­iar with Java or Python. It is the first com­pletely in­ter­ac­tive, dis­trib­uted stream­ing SQL engine for Apache Kafka,” said Neha Narkhede, co-founder and CTO, Con­flu­ent, in a state­ment.

KSQL for stream­ing data is quite dif­fer­ent from tra­di­tional ra­tio­nal SQL data­bases. The data is un­bound, whereas the queries are con­tin­u­ously run­ning and pro­duc­ing results. Con­flu­ent be­lieves that it is eas­ier to learn ad­di­tional con­cepts and con­structs while us­ing a fa­mil­iar lan­guage and tools.

Con­flu­ent has made ma­jor progress with Kafka. The plat­form has be­come the top choice for real-time en­ter­prise ap­pli­ca­tion de­vel­op­ment. It has also be­come more than just data in­ges­tion in re­cent years.

Newspapers in English

Newspapers from India

© PressReader. All rights reserved.