Top Research Papers on Kafka
Delve into the Top Research Papers on Kafka and discover a wealth of information ranging from theoretical concepts to practical applications. Perfect for academics, professionals, and enthusiasts looking to deepen their understanding of this influential topic. Each paper offers unique insights and valuable contributions to the field.
Looking for research-backed answers?Try AI Search
In the first book to study Franz Kafka from the perspective of modern rhetorical theory, Clayton Koelb explores such questions as how Kafka understood the reading process, how he thematized the problematic of reading, and how his highly distinctive style relates to what Koelb describes as the "passion of reading."
Abstract This study provides a detailed investigation of Jorge Luis Borges’s development as an author in light of (1) Franz Kafka’s influence on Borges’s writing and (2) Borges’s relationship with his father, Jorge Guillermo Borges (Borges père, a failed author). Reading Borges’s stories with respect to the influence of these literary and familial precursors explains some of his aims as a writer. Borges believed that much of Kafka’s writing derived from his personal experiences, particularly his relationship with his father. Following Borges’s lead, this book looks at how reading Kafka helped ...
Nonhuman figures are ubiquitous in the work of Franz Kafka, from his early stories down to his very last one. Despite their prominence throughout his oeuvre, Kafka's animal representations have been considered first and foremost as mere allegories of intrahuman matters. In recent years, the allegorization of Kafka's animals has been poetically dismissed by Kafka's commentators and politically rejected by posthumanist scholars. Such critique, however, has yet to inspire either an overarching or an interdiscursive account. This book aims to fill this lacuna. Positing animal stories as a distinct...
Apache Kafka: Real Time Implementation with Kafka Architecture Review
16 Citations 2017Javed Ahmed Shaheen
International Journal of Advanced Science and Technology
Unluckily today's general architectures for the real time data and its processing at extent suffer from too much complexity: let we say, lot of technologies that need to be darned and operated together, and each individual technology is often complex by itself.Let we have to desire to publish and subscribe, streams of records then Apache Kafka is similar to a message queue or we can say it is an enterprise messaging system.Let we have to store streams of records in a fault-tolerant way: Kafka process streams of records as they occur.Kafka is better for applications of two broad classes one is ...
Kafka versus RabbitMQ
149 Citations 2017Philippe Dobbelaere, Kyumars Sheykh Esmaili
journal unavailable
This paper establishes a common comparison framework based on the core functionalities of pub/sub systems and enumerates a set of use cases that are best suited for RabbitMQ or Kafka, to guide the reader through a determination table to choose the best architecture given his/her particular set of requirements.
KafKa: Gradual Typing for Objects
16 Citations 2018Benjamin Chung, Paley Li, Francesco Zappa Nardelli + 1 more
Leibniz-Zentrum für Informatik (Schloss Dagstuhl)
This paper shows that four of the most common gradual type systems provide distinct guarantees, and gives a formal framework for comparing gradualtype systems for object-oriented languages.
The Kafka quagmire for the poor in India
11 Citations 2017Russell W. Belk, Tanuka Ghoshal
Journal of Marketing Management
ABSTRACTKhare and Varman present a compellingly pessimistic analysis of the plight of the poor in India. The dilemmas of the poor are often exacerbated by large corporations seeking to find ways to market products to impoverished emerging market consumers. In India, consumers are frequently hurt by these initiatives, small retailers may suffer, while corruption and trickery by petty bureaucrats and ruthless landlords help the rich get richer at the expense of the poor. The article by Khare and Varman is a scathing indictment based on detailed ethnographic evidence but it reveals only a fractio...
Kafka's Laughter: On Joy and the Kafkaesque
17 Citations 2015Anca Parvulescu
PMLA/Publications of the Modern Language Association of America
In a letter Franz Kafka wrote to Felice Bauer in January 1913, he describes himself as a “great laugher.” Although Kafka is conventionally associated with anxiety, gloom, even terror, his laughter is joyful.
With access to Kafka's medical records, Sander Gilman engages in an analysis of hyperchondria, anorexia, homosexuality, turn-of-the-century ritual slaughter, and myths about the relationship of body type to character.
Extending Kafka Streams for Complex Event Recognition
10 Citations 2020Samuele Langhi, Riccardo Tommasini, Emanuele Della Valle
journal unavailable
KELPr is an in-memory distributed CER engine designed extending the Dual Streaming Model and implemented on top of Kafka Streams, a first step towards a unifying solution for Streaming Analytics and Complex Event Recognition.
Kafka, Samza and the Unix Philosophy of Distributed Data
34 Citations 2015Martin Kleppmann, Jay Kreps
Apollo (University of Cambridge)
The reasoning behind the design of Kafka and Samza, which allow complex applications to be built by composing a small number of simple primitives – replicated logs and stream operators, is explained.
Performance Prediction for the Apache Kafka Messaging System
44 Citations 2019Han Wu, Zhihao Shang, Katinka Wolter
journal unavailable
A queueing based packet flow model is proposed to predict performance metrics of Kafka cloud services and achieves high accuracy in predicting throughput and latency.
A Survey on Networked Data Streaming With Apache Kafka
77 Citations 2023Theofanis P. Raptis, Andrea Passarella
IEEE Access
This survey paper systematically surveys the research literature in this field by carefully classifying it into key macro areas, namely algorithms, networks, data, cyber-physical systems, and security, and aims to identify and analyze the optimization aspects relevant to each area.
Building a replicated logging system with Apache Kafka
157 Citations 2015Guozhang Wang, Joel Koshy, Sriram Subramanian + 6 more
Proceedings of the VLDB Endowment
This abstract will talk about the design and engineering experience to replicate Kafka logs for various distributed data-driven systems at LinkedIn, including source-of-truth data storage and stream processing.
A Study of Apache Kafka in Big Data Stream Processing
84 Citations 2018Bhole Rahul Hiraman, Chapte Viresh M., Karve Abhijeet C.
journal unavailable
In current era Apache Kafka is most popular architecture used for processing the stream data, which is scalable, distributed, and reliable result into high throughput.
Apache Kafka: A High-Throughput Distributed Messaging System
11 Citations 2015Khin Me Me Thein, Thi Thi Soe Nyunt
journal unavailable
Apache Kafka is publish-subscribe messaging implemented as a distributed commit log, suitable for both offline and online message consumption. It is a messaging system initially developed at LinkedIn for collecting and delivering high volumes of event and log data with low latency. Message publishing is a mechanism for connecting various applications with the help of messages that are routed between them, for example, by a message broker such as Kafka. It acts as a kind of write-ahead log that records messages to a persistent store and allows subscribers to read and apply these changes to thei...
A Study of Distributed SDN Controller Based on Apache Kafka
10 Citations 2020Ju-Hyeon Moon, Yong-Tae Shine
journal unavailable
The distributed message system of Apache Kafka was designed to support large-scale distributed messages between SDN controllers and the message processing time of Kafka and the existing Message Queue was measured.
Formalization and verification of Kafka messaging mechanism using CSP
11 Citations 2022Junya Xu, Jiaqi Yin, Huibiao Zhu + 1 more
Computer Science and Information Systems
The process algebra CSP (Communicating Sequential Processes) and the model checking tool PAT (Process Analysis Toolkit) are applied and the results show that the Kerberos protocol has improved the security of Kafka messaging mechanism in some aspects, but there are still some security loopholes.
From Weber to Kafka: Political Instability and the Overproduction of Laws
89 Citations 2021Gabriele Gratton, Luigi Guiso, Claudio Michelacci + 1 more
American Economic Review
With inefficient bureaucratic institutions, the effects of laws are hard to assess and incompetent politicians may pass laws to build a reputation as skillful reformers. Since too many laws curtail bureaucratic efficiency, this mechanism can generate a steady state with Kafkaesque bureaucracy. Temporary surges in political instability heighten the incentives to overproduce laws and can shift the economy towards the Kafkaesque state. Consistent with the theory, after a surge in political instability in the early 1990s, Italy experienced a significant increase in the amount of poor-quality legis...
Hunger and Modern Writing: Melville, Kafka, Hamsun, and Wright
35 Citations 2016Daniel Rees
journal unavailable
"Hunger is a contentious theme in modernist literature, and this study addresses its relevance in the works of four major American and European writers. Taking an in-depth look at works by Melville, Kafka,Hamsun, and Wright, it argues that hunger is deeply involved with concepts of modernity and modern literature. Exploring how it is bound up with the writer’s role in modern society this study draws on two conflicting and complex views of hunger: the first is material, relating to the body as a physical entity that has a material existence in reality. Hunger, in this sense, is a physiological ...
Learning to Reliably Deliver Streaming Data with Apache Kafka
30 Citations 2020Han Wu, Zhihao Shang, Katinka Wolter
journal unavailable
A rough dynamic configuration scheme is proposed, which significantly improves the reliability of Kafka while guaranteeing message timeliness, and a weighted key performance indicator (KPI) of Kafka is proposed for selecting proper configuration parameters.
Spark Structured Streaming: Customizing Kafka Stream Processing
11 Citations 2020Yuriy Drohobytskiy, Vitaly Brevus, Yuriy Skorenkyy
journal unavailable
An improvement of large-scale multi-party data exchange and stream processing solution that uses Apache Kafka streams as well as HDFS file granulation and is exemplified in a real project of data ingestion into the Hadoop ecosystem.
Kafka and Deleuze/Guattari: Towards a Creative Critical Writing Practice
12 Citations 2016Ola Ståhl
Theory Culture & Society
Drawing upon the work of Gilles Deleuze and Félix Guattari, in particular their writing on Franz Kafka, this article stakes out the ground for a creative critical writing practice beyond the confines of literature. Exploring the notion of writing in relation to affect constellations, what causes one to write, and expressions without content, how one begins to write, the argument put forth is that in rethinking the distinction Deleuze and Guattari tend to make between artistic practice and philosophical thought, a space is opened up for transversal lines that may cross between these fields in p...
Kafka and Its Using in High-throughput and Reliable Message Distribution
26 Citations 2015Zhenghe Wang, Wei Dai, Feng Wang + 4 more
journal unavailable
Though Kafka is still able to be improved in some aspects, it's expected to have broad development prospects as it is suitable for both online and offline processing simultaneously.
A study of a video analysis framework using Kafka and spark streaming
36 Citations 2017Ichinose Ayae, Atsuko Takefusa, Hidemoto Nakada + 1 more
journal unavailable
A video analysis framework that collects videos from multiple cameras and analyzes them using Apache Kafka and Apache Spark Streaming is proposed and the experimental results show that the overall throughput varies depending on the number of broker nodes that store data, thenumber of topic partitions of data, and the numberof nodes that conduct analysis processing.
Field of genes: using Apache Kafka as a bioinformatic data repository
14 Citations 2018Brendan Lawlor, Richard Lynch, Micheál Mac Aogáin + 1 more
GigaScience
Abstract Background Bioinformatic research is increasingly dependent on large-scale datasets, accessed either from private or public repositories. An example of a public repository is National Center for Biotechnology Information's (NCBI's) Reference Sequence (RefSeq). These repositories must decide in what form to make their data available. Unstructured data can be put to almost any use but are limited in how access to them can be scaled. Highly structured data offer improved performance for specific algorithms but limit the wider usefulness of the data. We present an alternative: lightly str...
Beyond Weber and Kafka: Conceptualizing a Critical Realist Model of Bureaucracy
10 Citations 2021Yi Yang
Administration & Society
Max Weber and Franz Kafka are seminal writers on bureaucracy and administration. While Weber suggests the technical superiority of a bureaucratic “iron cage,” Kafka speaks from within that cage, seeing its repressive rationality as being confounded by recalcitrant citizens searching for freedom. However, if individuals are embedded in a bureaucracy that limits the parameters of actions from which they can choose, how could they ever defy structural control? Articulating the conditions for human liberty, this article uses critical realism to reveal the potential emancipatory nature of bureaucra...
Real-Time Kafka-Based Topic Modeling and Identification of Tweets
11 Citations 2021George Manias, Argyro Mavrogiorgou, Athanasios Kiourtis + 2 more
journal unavailable
An end-to-end pipeline that primarily focuses on the phases of the collection, text preprocessing, as well as utilization of Natural Language Processing and Topic Modeling models, which are considered to be of major importance for the successful Topic modeling and Identification of Tweets and the final interpretation of them are introduced.
Research Proposal: Reliability Evaluation of the Apache Kafka Streaming System
13 Citations 2019Han Wu
journal unavailable
This research test the impacts of all kinds of configuration parameters on the reliability of Kafka, including retry strategies and replications of partitions for fault tolerance, as well as the tradeoffs between performance and reliability.
Modeling and Verifying Producer-Consumer Communication in Kafka Using CSP
12 Citations 2021Junya Xu, Jiaqi Yin, Huibiao Zhu + 1 more
journal unavailable
This paper model the communication between producers and consumers in Kafka by the process algebra CSP (Communicating Sequential Processes), and applies the model checking tool PAT (Process Analysis Toolkit) to verify five properties of the system namely Deadlock Freedom, Acknowledgement Mechanism, Parallelism, Sequentiality and Fault Tolerance.
Large Scale Image Processing in Real-Time Environments with Kafka
13 Citations 2017Yoon-Ki Kim, Chang‐Sung Jeong
journal unavailable
This paper provides a new method for constructing a distributed environment using open source called Apache Kafka for real-time processing of large-scale images using GPGPU or Xeon-Phi processing.
A study on Modern Messaging Systems- Kafka, RabbitMQ and NATS Streaming
24 Citations 2019T Sharvari, Sowmya Nag K
arXiv (Cornell University)
This survey paper outlines the modern messaging technologies and delves deep on three popular publisher/subscriber systems- Apache Kafka, RabbitMQ and NATS Streaming.
Bridging MQTT and Kafka to support C-ITS: a feasibility study
23 Citations 2020Åsmund Hugo, Brice Morin, Karl Svantorp
journal unavailable
A novel approach is to bridge C-ITS message types over MQTT, to Apache Kafka, with fault-tolerance, horizontal scalability, and low latency, and shows the feasibility by managing to source and sink CAM messages with low latency.
Reliable and scalable Kafka-based framework for optical network telemetry
38 Citations 2021Andrea Sgambelluri, Alessandro Pacini, Francesco Paolucci + 2 more
Journal of Optical Communications and Networking
A novel Kafka-based monitoring framework leveraging the telemetry service that exploits the built-in scalability and reliability of Kafka to go beyond traditional monitoring systems, and is capable of overcoming the failure of a monitoring framework core component without losing any message.
Kafka-ML: Connecting the data stream with ML/AI frameworks
62 Citations 2021Cristian Martín, Peter Langendöerfer, Pouya Soltani Zarrin + 2 more
Repositorio Institucional de la Universidad de Málaga (University of Málaga)
Kafka-ML is proposed, an open-source framework that enables the management of TensorFlow ML/AI pipelines through data streams (Apache Kafka) and provides an accessible and user-friendly Web User Interface where users can easily define ML models, to then train, evaluate and deploy them for inference.
Research on Establish an Efficient Log Analysis System with Kafka and Elastic Search
12 Citations 2017Yuanzhou Wei, Manman Li, Bin-Sen Xu
Journal of Software Engineering and Applications
This paper introduces a way how to build an efficient logs analysis system based on kafka and Elastic Search and hopes you can learn something through the iteration of the Version and get some inspiration with your own log analysis system.
In a test bed with Kafka. Introducing a mixed-method approach to digital stylistics.
11 Citations 2017J. Berenike Herrmann
Publikationen an der Universität Bielefeld (Universität Bielefeld)
The present article discusses common methods of distant, close, and ‘scalable reading’ as well as a flexibly adjustable definition of style, and reports a ‘mixed-methods digital stylistics’ study on Franz Kafka’s prose.
KAFKA: The modern platform for data management and analysis in big data domain
50 Citations 2017R.P Saghana Shree, Tanupriya Choudhury, Subhash Chand Gupta + 1 more
2017 2nd International Conference on Telecommunication and Networks (TEL-NET)
Apache Kafka is a distributed streaming platform mainly designed for low latency and high throughput, designed to allow a single cluster to serve the central data backbone for a large organization.
Towards flexible data stream collaboration: Federated Learning in Kafka-ML
13 Citations 2024Antonio Jesús Chaves, Cristian Martín, Manuel Díáz
Internet of Things
Federated learning is applied in scenarios where organisations lack sufficient data volume for modelling their business logic and cannot share their data with external parties. Moreover, Industry 4.0 and IoT scenarios generate massive data streams, which normally are fed to ML/AI solutions for model training and prediction. However, in most cases, ML/AI frameworks are not prepared to work with these streaming pipelines. In this paper, we present an asynchronous federated learning solution based on the Kafka-ML data stream framework, which is able to combine federated learning and data stream c...
Image Steganography Using Blowfish Algorithm and Transmission via Apache Kafka
17 Citations 2022Shivam Ilasariya, Parth J. Patel, Vatsal Patel + 1 more
2022 4th International Conference on Smart Systems and Inventive Technology (ICSSIT)
The primary attention is concerned with enforcing steganography for photographs, with an advanced safety and picture resolution, and blowfish encryption will be used.