Job Title: Data Engineer – Scala: Hadoop, Hive, Spark, Scala, ETL
Location: Bengaluru (Hybrid)
Job Type: Full-Time
Experience Level: 5-8 years
Company Description:
Tech T7 Innovations is a company that provides IT solutions to clients worldwide. The team consists of highly skilled and experienced professionals who are passionate about IT. Tech T7 Innovations offers a wide range of IT services, including software development, web design, cloud computing, cybersecurity, data engineering, data science and machine learning. The company is committed to staying up-to-date with the latest technologies and best practices to deliver the best solutions to their clients.
Job Summary:
We are looking for a highly skilled Scala Developer with 5-8 years of experience to join our dynamic team. The ideal candidate will have expertise in designing, developing, and deploying scalable, high-performance applications. This role requires a strong foundation in Scala programming, functional programming concepts, and familiarity with distributed systems.
Key Responsibilities
Application Development:
- Design, develop, and maintain scalable and high-performance applications using Scala.
- Collaborate with team members to build robust and efficient backend services.
Functional Programming:
- Leverage functional programming principles to write clean, maintainable, and testable code.
Distributed Systems:
- Work on distributed systems and big data frameworks, ensuring fault tolerance and scalability.
Data Processing Pipelines:
- Build and optimize data pipelines, integrating with tools like Spark, Kafka, and Akka Streams.
Performance Optimization:
- Profile and optimize applications for performance, scalability, and reliability.
Collaboration:
- Work closely with product managers, QA engineers, and DevOps teams to deliver high-quality solutions.
Code Quality and Standards:
- Ensure adherence to best practices, coding standards, and agile methodologies.
Documentation:
- Create and maintain technical documentation for systems and processes.
Required Skills and Qualifications
Technical Expertise:
- Proficiency in Scala and a strong understanding of functional programming principles.
- Hands-on experience with frameworks such as Akka, Play, or Lagom.
- Solid understanding of concurrency, multithreading, and asynchronous programming.
- Familiarity with big data processing frameworks like Apache Spark.
- Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Cassandra, MongoDB).
DevOps and Cloud:
- Familiarity with CI/CD pipelines and cloud platforms (e.g., AWS, Azure, GCP).
- Experience with containerization tools like Docker and orchestration tools like Kubernetes is a plus.
Experience:
- 5-8 years of hands-on software development experience with at least 3+ years in Scala development.
Soft Skills:
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration abilities.
Required Skills & Qualifications
- Strong proficiency in Scala and its functional programming concepts.
- Hands-on experience with frameworks such as Akka, Play, or Cats.
- Experience with distributed computing frameworks like Apache Spark.
- Familiarity with databases (SQL and NoSQL) such as PostgreSQL, MongoDB, or Cassandra.
- Experience with containerization and orchestration using Docker and Kubernetes.
- Knowledge of CI/CD pipelines, DevOps best practices, and infrastructure as code (Terraform, Ansible, or similar).
- Strong problem-solving skills and the ability to work independently.
- Excellent communication and collaboration skills.
Preferred Qualifications
- Experience with event-driven architectures and tools like Kafka or RabbitMQ.
- Familiarity with monitoring and logging tools like Prometheus, Grafana, or ELK Stack.
- Knowledge of Agile development methodologies.
- Open-source contributions or a portfolio of projects demonstrating Scala expertise.
If you are passionate about Scala development and eager to build impactful solutions, we encourage you to apply and join our talented team.