Professional Experience

Associate Software Engineer

Prolifics Corporation Limited ā€“ Hyderabad, India

Oct 2021 ā€“ Dec 2023

    • Managed end-to-end data pipelines across production and staging Hadoop clusters, ensuring high availability and optimal performance of the ecosystem.
    • Configured and maintained Hadoop components (HDFS, YARN, Hive, Spark); performed NameNode/ResourceManager HA setup and executed seamless cluster upgrades.
    • Developed Spark-based batch jobs using PySpark and Spark SQL, improving job runtimes by 30% over legacy Hive scripts.
    • Monitored cluster health using Ganglia & Nagios; handled alerts related to memory, CPU, and storage, and enforced HDFS quota/purging policies.
    • Led root cause analysis for critical failures, reducing system downtime by 30% across ingestion and transformation jobs.
    • Containerized internal DTE project using Docker, ensuring consistent onboarding and environment parity across QA/dev setups.
    • Built and deployed a full-stack web application using React.js (frontend) and Node.js(backend).
    • Created reusable Python utilities for data parsing, automated configuration, and CLI-based task orchestration.
šŸ’¬