Job Description

Contract job Position
 

Job Title: Bigdata Splunk Engineer

Work Location: Berkeley Heights, NJ

Eligibility: B.E / BSc / B.Tech / BCA / MCA
 

Job Description

Freshers will undergo comprehensive training in Splunk software, gaining the essential skills needed to thrive in various Splunk-related roles. This program includes practical, hands-on experience with Splunk, covering its architecture, core features, and functionalities. Participants will become proficient in utilizing Splunk for a variety of tasks. Upon completion, freshers will be well-prepared to take on diverse roles within the Splunk ecosystem, such as:

• User: Mastering Splunk for data searches, visualization, and report generation.
• Developer: Acquiring the ability to create custom Splunk applications, write tailored search queries, and utilize Splunk’s APIs.
• Admin: Developing expertise in configuring, managing, and optimizing Splunk environments, including user access control and data inputs.
• Architect: Gaining in-depth knowledge of Splunk’s architecture, with the ability to design and implement sophisticated Splunk solutions following best practices.
   

Role Objectives

• Develop and implement ETL pipelines that extract, transform, and load data into valuable insights, aligning with the organization's strategic objectives.
• Focus on handling large datasets by ingesting, storing, processing, and analyzing them efficiently.
• Design and build scalable, high-performance web services for tracking and monitoring data.
• Convert complex technical and functional requirements into detailed, actionable design plans.
• Evaluate and recommend alternatives for data storage and processing to ensure streamlined and efficient implementations.
• Mentor junior team members through technical training and reviewing their project deliverables.
   

Responsibilities

• Monitoring Strategy Development: Collaborate with internal operations, support teams, developers, and business owners to drive monitoring strategies, provide best practices, and plan resources effectively.
• Splunk Services Management: Oversee the installation, deployment, and ongoing support of Enterprise Splunk services.
• Tool Development and Automation: Create and enhance tools such as SolarWinds and New Relic, improve operational processes, and automate information security functions using Splunk and open-source technologies.
• Application Support and Extension: Maintain and extend existing Splunk information security applications, focusing on security, monitoring, task automation, continuous integration, deployment, and performance optimization.
• Data Collection and Reporting: Utilize Splunk to collect and index log data, develop queries, support log integration, and generate reports.
• Splunk Configuration and Troubleshooting: Install, configure, and troubleshoot Splunk to ensure optimal performance.
• Application Development Collaboration: Partner with application owners to develop applications for tracking and updating purposes.
• Technical Liaison: Act as the subject matter expert (SME) for all technical issues related to Splunk, liaising with other departments.
• Infrastructure Management: Architect, design, support, maintain, and expand the Splunk infrastructure, ensuring a highly resilient configuration.
• Mentorship and Training: Develop and mentor other teams and organizations on the effective use of Splunk.
   

Qualification

• Splunk Installation and Configuration: Install, configure, and troubleshoot Splunk to ensure seamless operation.
• Log Data Management: Utilize Splunk to collect, index, and analyze log data effectively.
• Application Monitoring Collaboration: Collaborate with application owners to develop or update monitoring solutions for various applications.
• Certification Requirements: Possess or be willing to obtain Splunk Administrator certification.
• Operating Systems Expertise: Demonstrate strong knowledge of Windows, Linux, and UNIX operating systems.
• Service Level Agreement Compliance: Respond to requests and incident tickets within the defined Service Level Agreements (SLAs).
    

Required Skills and Qualifications

• Proficiency in Python, Spark, and Hive.
• Strong understanding of data warehousing and data modeling techniques.
• Familiarity with industry-standard visualization and analytics tools (e.g., Tableau, R).
• Advanced data engineering skills, particularly on the Azure cloud platform.
• Experience working with streaming frameworks such as Kafka.
• Knowledge of Core Java, Linux, SQL, and at least one scripting language.
• Strong interpersonal skills and a positive, collaborative attitude.
   

Preferred Skills and Qualifications

• A degree in computer science, mathematics, or engineering.
• Expertise in ETL methodology for enterprise-wide solution design using DataStage.
   

Experience

• 6 years of experience working with the Splunk platform.
• Bachelor's Degree at College of Science, Technology, Engineering Math major or equivalent work, or military experience.
• Experience in system engineering, system administration, and scripting Knowledge of Windows and Linux operating systems.
• Excellent troubleshooting and problem-solving skills.
• Excellent communication and interpersonal skills Ability to work independently and as part of a team.