icon/x Created with Sketch.

Splunk Cookie Policy

We use our own and third-party cookies to provide you with a great online experience. We also use these cookies to improve our products and services, support our marketing campaigns, and advertise to you on our website and other websites. Some cookies may continue to collect information after you have left our website. Learn more (including how to update your settings) here.
Accept Cookie Policy

We are working on something new...

A Fresh New Splunkbase
We are designing a New Splunkbase to improve search and discoverability of apps. Check out our new and improved features like Categories and Collections. New Splunkbase is currently in preview mode, as it is under active development. We welcome you to navigate New Splunkbase and give us feedback.
Cancel Visit New Splunkbase Visit
My Account
Login Signup
Support & Services
Search Splunk Documentation Splunk Answers Education & Training User Groups Splunk App Developers Support Portal Contact Us
My Account
Login Signup
Support & Services
Search Splunk Documentation Splunk Answers Education & Training User Groups Splunk App Developers Support Portal Contact Us

Accept License Agreements

This app is provided by a third party and your right to use the app is in accordance with the license provided by that third-party licensor. Splunk is not responsible for any third-party apps and does not provide any warranty or support. If you have any questions, complaints or claims with respect to this app, please contact the licensor directly.

BaboonBones

Splunk Websites Terms and Conditions of Use

Thank You

Downloading Kafka Messaging Modular Input
SHA256 checksum (kafka-messaging-modular-input_188.tgz) 2fbfa422d5be2601d4c612c010296b5d8fedb616837db54cc07a2718e7387221 SHA256 checksum (kafka-messaging-modular-input_187.tgz) 1c4754235fa153d3ed670585d450ac5793f8a25c11ea6b60bc42b0d20d11cdf0 SHA256 checksum (kafka-messaging-modular-input_186.tgz) 3a878e7bdae0fd783a8baaa2fd249f9d68330ac4c264f62c0d876671790da4d2 SHA256 checksum (kafka-messaging-modular-input_185.tgz) f16f9b041dcc9d256550d10e21e7a91d16504842f1dc6759bdd9b3f133e3bb0b SHA256 checksum (kafka-messaging-modular-input_184.tgz) 44bfc6ac1daec52870e6595aad668d9a6f6f92fd868e7e0ace8c7821950e1570 SHA256 checksum (kafka-messaging-modular-input_183.tgz) f8614c36ad5bd8c506cf8d3c679bfe6598a2070149c6da6bbe20f3911bc9230c SHA256 checksum (kafka-messaging-modular-input_182.tgz) 72a523bc2ea702530eb6cbe6669ae9e6f877caebb63fbd514725c3e73e81fd94 SHA256 checksum (kafka-messaging-modular-input_181.tgz) 130b36919d8fd8fbc51e0b4c79e2771aedc80f42794ae0f94d6d366f8f1b5109 SHA256 checksum (kafka-messaging-modular-input_180.tgz) 011c68453ec8bc0b5b0c9e9deb4913678a610a172ca2be674cfc8b5cd653a8bb SHA256 checksum (kafka-messaging-modular-input_17.tgz) 0de8fac3115d36cbcaf16ea2c07c0f6791f320835600e4cea803d3a83f1accb8 SHA256 checksum (kafka-messaging-modular-input_163.tgz) 9c93dbe862aec55ab2e535bbab46e680478c5d5aa837bd475b18e7139aa4f96f SHA256 checksum (kafka-messaging-modular-input_162.tgz) a1d63b1ce73e1e3772c2e1259f9d6e43d2b59d37d7b52092c724e3d5cafef339 SHA256 checksum (kafka-messaging-modular-input_161.tgz) 7baff5585d3010a3a9a57775a5f944b2688696c6015aa98fd649074fed85fa11 SHA256 checksum (kafka-messaging-modular-input_16.tgz) 632ed43e9bd7f58250f4c9d1f52d326345e69ca7f26c68700fedc307e354a0a9 SHA256 checksum (kafka-messaging-modular-input_15.tgz) fab9cee534db25155a5bc9c57de8291f43f99fe0474f98ed12899b22e8d4a79a SHA256 checksum (kafka-messaging-modular-input_14.tgz) 3e939955beb0228a3fbadde5f37badd9b6897da99616e21399aae8ef46a9d988 SHA256 checksum (kafka-messaging-modular-input_134.tgz) c34a4736f1bd7c2dbb0a992dcd8ca62b39ad9aa6ef32ff6e7f9b75aaa5e2731b SHA256 checksum (kafka-messaging-modular-input_133.tgz) f13d1a5e2b151d2fa3487078d46b9b47fd3576bb1fe9e7627a0eea9ea9b28df0 SHA256 checksum (kafka-messaging-modular-input_132.tgz) fe4c2b191cebbb31e13c68189359c94ad828f5f434bd3bff8528be3ffb6497b4 SHA256 checksum (kafka-messaging-modular-input_131.tgz) 8daeb9882e0d4b9445872e10d950cf7d6a66d78d8fa042987b1b694b03f2db93 SHA256 checksum (kafka-messaging-modular-input_13.tgz) 78b85b84f1080b1b415714c6dd97f4c06e3b120596ccdf8719c128b20bfbf97f SHA256 checksum (kafka-messaging-modular-input_12.tgz) c6260d8ec183a8b1dd0930c7021877b09c7bdaddc00a61ab20c7b7d36df41e6d SHA256 checksum (kafka-messaging-modular-input_11.tgz) 01bd28dfe1059e5bb98fbb80ab7ba7588fef183f8e6b0ac7c664c0211af785cc SHA256 checksum (kafka-messaging-modular-input_10.tgz) 2ac395538568c27a1374a75b2d2c4b23432fc9dd24fd912574147a2232b71db8 SHA256 checksum (kafka-messaging-modular-input_092.tgz) c1f22a08a740ed86347dd6e467575508716c410813329d9a8ce21355766a7e76 SHA256 checksum (kafka-messaging-modular-input_091.tgz) 9ac8e4c8ef15d9a3e459bcf8492ebc71dcd364ab501be1a974193b8ea3377b72 SHA256 checksum (kafka-messaging-modular-input_09.tgz) 8f1ba7545eae96aacac9ce410b73b5954154af2300597d891877a9100288948b SHA256 checksum (kafka-messaging-modular-input_081.tgz) 98af2ca98f99a15820f4b9fede8fc7945de7501537ce50a43ef4830a895d11cc SHA256 checksum (kafka-messaging-modular-input_08.tgz) 1aa6a74c5e94406a76683dd238724624adebadbbe15ed5d2ac25cf67157ea127 SHA256 checksum (kafka-messaging-modular-input_07.tgz) 1698725bee5a690e8cb6a5b09c584696f6a6e438b2621ee4d83c87064d38f95b SHA256 checksum (kafka-messaging-modular-input_06.tgz) a4db626e985eb26e002e57d456698392af380030b2219cd52d18113ebf25205b SHA256 checksum (kafka-messaging-modular-input_05.tgz) f8bed4a6e24768263a5f6a05081ee22147c6420e867a5facd089733c0ec0c48f
To install your download
For instructions specific to your download, click the Details tab after closing this window.

Flag As Inappropriate
splunk

Kafka Messaging Modular Input

Overview
Details
This is a Splunk Modular Input Add-On for indexing messages from an Apache Kafka broker or cluster of brokers.

The Python code in this App is dual 2.7/3 compatible.
This version of the App enforces Python 3 for execution of the modular input script when running on Splunk 8+ in order to satisfy Splunkbase AppInspect requirements.
If running this App on Splunk versions prior to 8 , then Python 2.7 will get executed.

For details of the support we offer for our Apps , browse to : https://www.baboonbones.com/#support

This App is fully AppInspect passed for installing in your own hosted Splunk Enterprise environments or on your own hosted Splunk Forwarders and forwarding the collected data into Splunk Cloud or installing directly in Splunk Cloud.

Browse here for documentation

Release Notes

Version 1.8.8
Jan. 3, 2024

updated the Java SDK
Version 1.8.7
Jan. 1, 2024

updated the Java SDK
Version 1.8.6
Oct. 12, 2022

updated the Java SDK
Version 1.8.5
June 18, 2022

  • in order to support huge modular input configuration xml strings when users want to run a very large number of inputs on 1 single instance of this app , we had to change the way that the child java process is invoked. Previously the xml string was passed as a program argument which could break the max argument size in the Linux kernel. Now we changed the logic to pass the xml string to the java process via the STDIN pipe.

  • The app performs periodic socket pings to the splunkd management port to determine if splunkd is still alive and if splunkd is not responding , usually because it has exited or is not network reachable, then the app self exits it's running java process.The default timeout is now 300 seconds. You can change this timeout value in bin/kafka.py by setting the SPLUNKD_TIMEOUT_SECS variable.

  • upgraded internal logging libraries to Log4j2 v2.17.2
Version 1.8.4
Dec. 23, 2021

fixed a bug in getting credentials from storage/passwords
Version 1.8.3
Dec. 23, 2021

upgraded internal logging libraries to Log4j2 v2.17.0
Version 1.8.2
Dec. 15, 2021

upgraded internal logging libraries to Log4j2 v2.16.0
Version 1.8.1
Dec. 11, 2021

upgraded internal logging libraries to Log4j2 v2.15.0
Version 1.8.0
Sept. 8, 2021
  • general updates to meet latest Cloud Vetting requirements
  • moved kafka_password out of inputs.conf , browse to the Setup Credentials menu tab and enter any kafka usernames/passwords you require.
  • activation key is now setup globally via a menu tab
  • removed the HEC output option, default is now stdout
Version 1.7
Feb. 18, 2021

Upgraded core Kafka libraries. ZooKeeper is no longer required to establish connections.You can now connect directly to a Kafka bootstrap server.
Version 1.6.3
Oct. 6, 2020

upgraded logging functionality
Version 1.6.2
Sept. 29, 2020

docs update
Version 1.6.1
Aug. 30, 2020

added a setup page to encrypt any credentials you require in your configuration
Version 1.6
Aug. 23, 2020

enforced python3 for execution of the modular input script.If you require Python2.7 , then download a prior version (such as 1.5).
Version 1.5
May 16, 2020

Dual Python 2.7 and 3+ compatibility.

App will run on :

Splunk Enterprise versions back to Splunk 5 where there is only a Python 2.7 runtime shipped
Splunk Enterprise version 8 where there is both a Python 2.7 and Python 3+ runtime shipped
Future versions of Splunk Enterprise where there is only a Python 3+ runtime
Version 1.4
Dec. 30, 2019

added JAXB dependencies for JRE 9+
fixed Splunk 8 compatibility for manager.xml file
Version 1.3.4
June 25, 2019

cosmetic fixes
Version 1.3.3
May 10, 2019

cosmetic fixes
Version 1.3.2
April 23, 2019

updated docs
Version 1.3.1
April 19, 2019

added trial key functionality
Version 1.3
March 28, 2019

docs updated
Version 1.2
June 3, 2018

minor manager xml ui tweak for 7.1
Version 1.1
May 27, 2018

Added an activation key requirement , visit http://www.baboonbones.com/#activation to obtain a free,non-expiring key
Docs updated
Splunk 7.1 compatible
Version 1.0
April 21, 2016

Added a new custom handler : com.splunk.modinput.kafka.CSVWithHeaderDecoderHandler
This allows you to roll out CSV files (with or without header) into KV or JSON before indexing.

Example config you could pass to the custom message handler when you declare it

headers=header1:header2:header3,outputFormat=json,hasHeaderRow=false
Version 0.9.2
Nov. 3, 2015

Better JSON handling for HEC output (hat tip to Tivo)
Version 0.9.1
Oct. 22, 2015

Better logging around HEC success/failure
Can now add custom timestamp into HEC payload
New custom handler (JSONBodyWithTimeExtraction) for pulling out timestamp from JSON messages from Kafka and adding this into HEC payload
Version 0.9
Sept. 22, 2015

Added support to optional output to Splunk via a HEC (HTTP Event Collector) endpoint
Version 0.8.1
June 20, 2015

Added support for raw connection string format so that multiple zookeeper hosts
can be provided in a comma delimited manner
ie: hostname1:port1,hostname2:port2,hostname3:port3/chroot/path
Version 0.8
June 17, 2015

Added chroot support for zookeeper connection strings
Version 0.7
Feb. 11, 2015

Enabled TLS1.2 support by default.
Made the core Modular Input Framework compatible with latest Splunk Java SDK
Please use a Java Runtime version 7+
If you need to use SSLv3 , you can turn this on in bin/kafka.py
SECURE_TRANSPORT = "tls"

SECURE_TRANSPORT = "ssl"
Version 0.6
Feb. 5, 2015

You can now pass a charset name to the DefaultHandler
Version 0.5
June 30, 2014

Initial beta release
7,842
Downloads
Share Subscribe LOGIN TO DOWNLOAD
Version
Built by
BaboonBones Ltd
Contributors
BaboonBones Ltd
Support
Developer Supported
Contact Developer Questions on Splunk Answers Flag as inappropriate App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs App Contents: Inputs
Compatibility
Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise Products: Splunk Enterprise
Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 9.3, 9.2, 9.1, 9.0, 8.2, 8.1, 8.0, 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.3, 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.2, 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.1, 7.0 Platform: Platform Independent Splunk Versions: 7.1, 7.0 Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent Platform: Platform Independent
Licensing
BaboonBones
Category & Contents
Categories: IT Operations, IoT & Industrial Data
App Type: Add-on
Subscribe Share

Are you a developer?

As a Splunkbase app developer, you will have access to all Splunk development resources and receive a 10GB license to build an app that will help solve use cases for customers all over the world. Splunkbase has 1000+ apps from Splunk, our partners and our community. Find an app for most any data source and user need, or simply create your own with help from our developer portal.

Submit New Splunk App Dev Resources
PLATFORM
Data-to-Everything Platform
Splunk Cloud
Splunk Enterprise
Splunk Machine Learning Toolkit
Splunk Data Stream Processor
Pricing
Free Trials & Downloads
SECURITY PRODUCTS
Splunk Enterprise Security
Splunk Phantom
Splunk Mission Control
Splunk User Behavior Analytics
IT OPERATIONS & OBSERVABILITY PRODUCTS
Splunk Infrastructure Monitoring
Splunk IT Service Intelligence
Splunk Application Performance Monitoring
Splunk On-Call
SOLUTIONS BY INITIATIVE
Cloud Transformation
SOLUTIONS BY FUNCTION
Security
IT
Devops
SOLUTIONS BY INDUSTRY
Aerospace & Defense
Communications
Energy & Utilities
Financial Services
Healthcare
Higher Education
Manufacturing
Nonprofits
Online Services
Public Sector
Retail
WHY SPLUNK?
Why Splunk?
Customer Stories
Partners
Data-to-Everything
Diversity & Inclusion
SUPPORT
Support Portal
Support Programs
Splunk Answers
Contact Us
Product Security Updates
RESOURCES
Events
Webinars
Blogs
Customer Success
Expert Services
Data Insider
View All Resources
FOR DEVELOPERS
Documentation
Best Practices
Get Started with Splunk
Training & Certification
User Groups
Community
Splunkbase
Splunk dev
COMPANY
About Splunk
Careers
Leadership
Splunk for Good
Splunk Ventures
Splunk Protects
Newsroom
COVID-19 Response
SPLUNK SITES
.conf
Splunk Live!
T-Shirt Store
Investor Relations
Follow Us:
© 2005-2024 Splunk LLC All rights reserved.
Sitemap | Privacy | Website Terms of Use | Splunk Licensing Terms | Export Control | Modern Slavery Statement | Splunk Patents | Report a Problem
Splunk, Splunk>,Turn Data Into Doing, Data-to-Everything, and D2E are trademarks or registered trademarks of Splunk LLC in the United States and other countries. All other brand names,product names,or trademarks belong to their respective owners.