icon/x Created with Sketch.

Splunk Cookie Policy

We use our own and third-party cookies to provide you with a great online experience. We also use these cookies to improve our products and services, support our marketing campaigns, and advertise to you on our website and other websites. Some cookies may continue to collect information after you have left our website. Learn more (including how to update your settings) here.
Accept Cookie Policy

We are working on something new...

A Fresh New Splunkbase
We are designing a New Splunkbase to improve search and discoverability of apps. Check out our new and improved features like Categories and Collections. New Splunkbase is currently in preview mode, as it is under active development. We welcome you to navigate New Splunkbase and give us feedback.
Cancel Visit New Splunkbase Visit
My Account
Login Signup
Support & Services
Search Splunk Documentation Splunk Answers Education & Training User Groups Splunk App Developers Support Portal Contact Us
My Account
Login Signup
Support & Services
Search Splunk Documentation Splunk Answers Education & Training User Groups Splunk App Developers Support Portal Contact Us

Accept License Agreements

This app is provided by a third party and your right to use the app is in accordance with the license provided by that third-party licensor. Splunk is not responsible for any third-party apps and does not provide any warranty or support. If you have any questions, complaints or claims with respect to this app, please contact the licensor directly.

BaboonBones

Splunk Websites Terms and Conditions of Use

Thank You

Downloading Kafka Messaging Modular Input
SHA256 checksum (kafka-messaging-modular-input_188.tgz) d451343ecb550bc26d8e96f1c89bc6425753307d9b2d0069f012cbdab9428550 SHA256 checksum (kafka-messaging-modular-input_187.tgz) 88d5cb184d31bf0526b76a3be34d70aa3937ce6d78b10f17c0b3cc80dcf1ebbf SHA256 checksum (kafka-messaging-modular-input_186.tgz) 1a612a3ca7a6b8fdacb6f346833ac51144a1a4722085acb19c910a7ef1d34786 SHA256 checksum (kafka-messaging-modular-input_185.tgz) d1f83a1b9c97bc99ee4b179262202148b293410ade3f45992cad722db843f6cc SHA256 checksum (kafka-messaging-modular-input_184.tgz) 05d94aac557b56f3cddd36cb56e70ec4727b808451bd859af402a26b6aa68bde SHA256 checksum (kafka-messaging-modular-input_183.tgz) af9e347866e5cc439876d0b97063fea52de38d075717d764954ad50c78929352 SHA256 checksum (kafka-messaging-modular-input_182.tgz) 5cbb358525ecb708b35236a4bcb454d494467836f4ace2733c58210fb19b4a9f SHA256 checksum (kafka-messaging-modular-input_181.tgz) a804419e3ddc271bbf51e671ea56e2c9228e4fef4fc3b503eee33865b5180ce6 SHA256 checksum (kafka-messaging-modular-input_180.tgz) 5199fb866d9885887f604d6fc6665b8757fd73ae04df3fe198ca16514c748032 SHA256 checksum (kafka-messaging-modular-input_17.tgz) c7be806821e2857b5218c1fce4e85ec9387d6be26556ced3473fc2d726f9968a SHA256 checksum (kafka-messaging-modular-input_163.tgz) bb515bbdffd967e3245a902a7848c01bc2446f401f8a484f86e9571df098ffb3 SHA256 checksum (kafka-messaging-modular-input_162.tgz) c731c6172b27037481454f8ddcc82913e314b2ed36be55104dd59a43d52ef6a9 SHA256 checksum (kafka-messaging-modular-input_161.tgz) 3d69d24a337c8d6b6984ec6c187d30817f923e3e4422f6dc077b46b832e00f43 SHA256 checksum (kafka-messaging-modular-input_16.tgz) 5fa78bc5012fcb12dacd9a9cc6ea2e9164cb42936d6ee004b25bd983f3386a66 SHA256 checksum (kafka-messaging-modular-input_15.tgz) 87208dba1902a69c35d1242f42c11d67190e9e1c3075442bc91d5ed173394e2e SHA256 checksum (kafka-messaging-modular-input_14.tgz) 12a33a077f535f16552d2840b37aab2344068adde32d0767a40a6e49d5b1882e SHA256 checksum (kafka-messaging-modular-input_134.tgz) b4bd6c5de29350594f3e4817ea952d4cbf0c170749cb875d36994417afec5eee SHA256 checksum (kafka-messaging-modular-input_133.tgz) ccc8a79437470e6d5f0c5fc49f8a8d52e6ac94094a91460432c5f2086fb646ff SHA256 checksum (kafka-messaging-modular-input_132.tgz) 92f2769ac99ecee0c2834fdf1744073007dbf5d961dc08b1d790573611bb4254 SHA256 checksum (kafka-messaging-modular-input_131.tgz) dea2b0a67c00e04c9637f83f72f266bc58e80dd6cd58aa2122f070f81a20202e SHA256 checksum (kafka-messaging-modular-input_13.tgz) 7ee13724165086cdc496e198a07553ab4f002e5abef5e5772ba21e7046b8f4bf SHA256 checksum (kafka-messaging-modular-input_12.tgz) 8550a6720b34ee26d1d198225b52db7422f92e03654b286fed2bf5ef5d4ad0aa SHA256 checksum (kafka-messaging-modular-input_11.tgz) 495746e91172bd0f31ce360a3629389a9d8d7fbeca942bdcf934e3a4e8130744 SHA256 checksum (kafka-messaging-modular-input_10.tgz) 412538d95b313cebf05539a290aa48fe04cf1e823e3a9e4bde1014857eef0e0a SHA256 checksum (kafka-messaging-modular-input_092.tgz) 71993948ed293aa11ae1fa73c9ee530cf58d67fdfd0b9b08b71de214d1151deb SHA256 checksum (kafka-messaging-modular-input_091.tgz) bafbe8ad5f9c2a521d20a301c83aa1e16425bf71a5896a02e6849b537cbc6b7c SHA256 checksum (kafka-messaging-modular-input_09.tgz) 095fbf7d1031ffddfcbbbe2d1718bb35ca2106427a2bd3b6081b321dbaadb183 SHA256 checksum (kafka-messaging-modular-input_081.tgz) 6f242fc36fc428c014d93990ad53b72243286f8302788d542e94d1afcaa3b2d2 SHA256 checksum (kafka-messaging-modular-input_08.tgz) 5c4c32852301f7728f4ed35520c07055cd730ba6a4e10e7b9c28b2f9d0f1b8df SHA256 checksum (kafka-messaging-modular-input_07.tgz) 8e22dfe6a1ef50d4822940e025fcf37901f2f4dedc892e989fed182c8e3861b4 SHA256 checksum (kafka-messaging-modular-input_06.tgz) 0a3ff5a4021ea35a236e82c44b32e4cd8ecaae375ed35a9beecb867e03b4f030 SHA256 checksum (kafka-messaging-modular-input_05.tgz) 358449174b8d81d80ae95d6dd9c1e30092e0c576d89463bc167659d53571b09d
To install your download
For instructions specific to your download, click the Details tab after closing this window.

Flag As Inappropriate
splunk

Kafka Messaging Modular Input

Overview
Details
This is a Splunk Modular Input Add-On for indexing messages from an Apache Kafka broker or cluster of brokers.

The Python code in this App is dual 2.7/3 compatible.
This version of the App enforces Python 3 for execution of the modular input script when running on Splunk 8+ in order to satisfy Splunkbase AppInspect requirements.
If running this App on Splunk versions prior to 8 , then Python 2.7 will get executed.

For details of the support we offer for our Apps , browse to : https://www.baboonbones.com/#support

This App is fully AppInspect passed for installing in your own hosted Splunk Enterprise environments or on your own hosted Splunk Forwarders and forwarding the collected data into Splunk Cloud or installing directly in Splunk Cloud.

Browse here for documentation

Release Notes

Version 1.8.8
Jan. 3, 2024

updated the Java SDK
Version 1.8.7
Jan. 1, 2024

updated the Java SDK
Version 1.8.6
Oct. 12, 2022

updated the Java SDK
Version 1.8.5
June 18, 2022

  • in order to support huge modular input configuration xml strings when users want to run a very large number of inputs on 1 single instance of this app , we had to change the way that the child java process is invoked. Previously the xml string was passed as a program argument which could break the max argument size in the Linux kernel. Now we changed the logic to pass the xml string to the java process via the STDIN pipe.

  • The app performs periodic socket pings to the splunkd management port to determine if splunkd is still alive and if splunkd is not responding , usually because it has exited or is not network reachable, then the app self exits it's running java process.The default timeout is now 300 seconds. You can change this timeout value in bin/kafka.py by setting the SPLUNKD_TIMEOUT_SECS variable.

  • upgraded internal logging libraries to Log4j2 v2.17.2
Version 1.8.4
Dec. 23, 2021

fixed a bug in getting credentials from storage/passwords
Version 1.8.3
Dec. 23, 2021

upgraded internal logging libraries to Log4j2 v2.17.0
Version 1.8.2
Dec. 15, 2021

upgraded internal logging libraries to Log4j2 v2.16.0
Version 1.8.1
Dec. 11, 2021

upgraded internal logging libraries to Log4j2 v2.15.0
Version 1.8.0
Sept. 8, 2021
  • general updates to meet latest Cloud Vetting requirements
  • moved kafka_password out of inputs.conf , browse to the Setup Credentials menu tab and enter any kafka usernames/passwords you require.
  • activation key is now setup globally via a menu tab
  • removed the HEC output option, default is now stdout
Version 1.7
Feb. 18, 2021

Upgraded core Kafka libraries. ZooKeeper is no longer required to establish connections.You can now connect directly to a Kafka bootstrap server.
Version 1.6.3
Oct. 6, 2020

upgraded logging functionality
Version 1.6.2
Sept. 29, 2020

docs update
Version 1.6.1
Aug. 30, 2020

added a setup page to encrypt any credentials you require in your configuration
Version 1.6
Aug. 23, 2020

enforced python3 for execution of the modular input script.If you require Python2.7 , then download a prior version (such as 1.5).
Version 1.5
May 16, 2020

Dual Python 2.7 and 3+ compatibility.

App will run on :

Splunk Enterprise versions back to Splunk 5 where there is only a Python 2.7 runtime shipped
Splunk Enterprise version 8 where there is both a Python 2.7 and Python 3+ runtime shipped
Future versions of Splunk Enterprise where there is only a Python 3+ runtime
Version 1.4
Dec. 30, 2019

added JAXB dependencies for JRE 9+
fixed Splunk 8 compatibility for manager.xml file
Version 1.3.4
June 25, 2019

cosmetic fixes
Version 1.3.3
May 10, 2019

cosmetic fixes
Version 1.3.2
April 23, 2019

updated docs
Version 1.3.1
April 19, 2019

added trial key functionality
Version 1.3
March 28, 2019

docs updated
Version 1.2
June 3, 2018

minor manager xml ui tweak for 7.1
Version 1.1
May 27, 2018

Added an activation key requirement , visit http://www.baboonbones.com/#activation to obtain a free,non-expiring key
Docs updated
Splunk 7.1 compatible
Version 1.0
April 21, 2016

Added a new custom handler : com.splunk.modinput.kafka.CSVWithHeaderDecoderHandler
This allows you to roll out CSV files (with or without header) into KV or JSON before indexing.

Example config you could pass to the custom message handler when you declare it

headers=header1:header2:header3,outputFormat=json,hasHeaderRow=false
Version 0.9.2
Nov. 3, 2015

Better JSON handling for HEC output (hat tip to Tivo)
Version 0.9.1
Oct. 22, 2015

Better logging around HEC success/failure
Can now add custom timestamp into HEC payload
New custom handler (JSONBodyWithTimeExtraction) for pulling out timestamp from JSON messages from Kafka and adding this into HEC payload
Version 0.9
Sept. 22, 2015

Added support to optional output to Splunk via a HEC (HTTP Event Collector) endpoint
Version 0.8.1
June 20, 2015

Added support for raw connection string format so that multiple zookeeper hosts
can be provided in a comma delimited manner
ie: hostname1:port1,hostname2:port2,hostname3:port3/chroot/path
Version 0.8
June 17, 2015

Added chroot support for zookeeper connection strings
Version 0.7
Feb. 11, 2015

Enabled TLS1.2 support by default.
Made the core Modular Input Framework compatible with latest Splunk Java SDK
Please use a Java Runtime version 7+
If you need to use SSLv3 , you can turn this on in bin/kafka.py
SECURE_TRANSPORT = "tls"

SECURE_TRANSPORT = "ssl"
Version 0.6
Feb. 5, 2015

You can now pass a charset name to the DefaultHandler
Version 0.5
June 30, 2014

Initial beta release
8,043
Downloads
Share Subscribe LOGIN TO DOWNLOAD
Version
Built by
BaboonBones Ltd
Contributors
BaboonBones Ltd
Support
Developer Supported
Contact Developer Questions on Splunk Answers Flag as inappropriate App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs
Compatibility
Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise
Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.4, 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.1, 7.0 Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent
Licensing
BaboonBones
Category & Contents
Categories: IT Operations, IoT & Industrial Data
App Type: Add-on
Subscribe Share

Are you a developer?

As a Splunkbase app developer, you will have access to all Splunk development resources and receive a 10GB license to build an app that will help solve use cases for customers all over the world. Splunkbase has 1000+ apps from Splunk, our partners and our community. Find an app for most any data source and user need, or simply create your own with help from our developer portal.

Submit New Splunk App Dev Resources
PLATFORM
Data-to-Everything Platform
Splunk Cloud
Splunk Enterprise
Splunk Machine Learning Toolkit
Splunk Data Stream Processor
Pricing
Free Trials & Downloads
SECURITY PRODUCTS
Splunk Enterprise Security
Splunk Phantom
Splunk Mission Control
Splunk User Behavior Analytics
IT OPERATIONS & OBSERVABILITY PRODUCTS
Splunk Infrastructure Monitoring
Splunk IT Service Intelligence
Splunk Application Performance Monitoring
Splunk On-Call
SOLUTIONS BY INITIATIVE
Cloud Transformation
SOLUTIONS BY FUNCTION
Security
IT
Devops
SOLUTIONS BY INDUSTRY
Aerospace & Defense
Communications
Energy & Utilities
Financial Services
Healthcare
Higher Education
Manufacturing
Nonprofits
Online Services
Public Sector
Retail
WHY SPLUNK?
Why Splunk?
Customer Stories
Partners
Data-to-Everything
Diversity & Inclusion
SUPPORT
Support Portal
Support Programs
Splunk Answers
Contact Us
Product Security Updates
RESOURCES
Events
Webinars
Blogs
Customer Success
Expert Services
Data Insider
View All Resources
FOR DEVELOPERS
Documentation
Best Practices
Get Started with Splunk
Training & Certification
User Groups
Community
Splunkbase
Splunk dev
COMPANY
About Splunk
Careers
Leadership
Splunk for Good
Splunk Ventures
Splunk Protects
Newsroom
COVID-19 Response
SPLUNK SITES
.conf
Splunk Live!
T-Shirt Store
Investor Relations
Follow Us:
© 2005-2025 Splunk LLC All rights reserved.
Sitemap | Privacy | Website Terms of Use | Splunk Licensing Terms | Export Control | Modern Slavery Statement | Splunk Patents | Report a Problem
Splunk, Splunk>,Turn Data Into Doing, Data-to-Everything, and D2E are trademarks or registered trademarks of Splunk LLC in the United States and other countries. All other brand names,product names,or trademarks belong to their respective owners.