About Encore Talent Solutions: Encore Talent Solutions is a trusted professional services firm dedicated to helping organizations achieve their goals by providing exceptional talent solutions. We partner closely with our clients to understand their unique culture and operational needs, delivering proactive support during times of growth, transition, and change. Our mission is to connect top talent with meaningful opportunities to drive business success.

Job DescriptionWe are seeking a Data Engineer/ Architect to join our dynamic team. In this role, you will play a key part in assessing, optimizing, and enhancing enterprise data integration platforms and pipeline architectures.
You will collaborate with cross-functional teams and stakeholders to deliver high-quality solutions in a fast-paced environment.

Key ResponsibilitiesNiFi Platform Assessment & Optimization

• Review existing Cloudera NiFi flows and architectures for efficiency, scalability, and maintainability.
• Assess current use cases to ensure NiFi is being applied appropriately and effectively.
• Identify opportunities to simplify flow designs, reduce operational overhead, and improve performance.
• Provide recommendations on best practices, standards, and reusable patterns.

Data Integration & Pipeline Support

• Support and enhance ETL and ELT pipelines built on NiFi.
• Integrate data from diverse sources including databases, APIs, filesystems, streaming platforms, and cloud storage.
• Troubleshoot data flow failures, latency issues, and throughput constraints.
• Implement robust error handling, monitoring, and recovery mechanisms.

Python & Custom Development

• Use Python for transformations, scripting, automation, and custom processor logic (where applicable).
• Support integration between NiFi and external systems using custom scripts or utilities.

Governance, Security & Operations

• Apply best practices for secure data movement, authentication, authorization, and encryption.
• Assist with flow versioning, deployment processes, and operational runbooks.
• Collaborate with internal teams to ensure platform changes align with operational and compliance requirements.

Advisory & Collaboration

• Act as a technical advisor to internal data and platform teams.
• Clearly document findings, recommendations, and implemented improvements.
• Provide knowledge transfer and guidance to ensure long-term sustainability.

Required Qualifications:

• Proficiency in: Cloudera NiFi, Python, ETL/ELT pipeline development, Linux-based systems, distributed data environments.
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork abilities.
• Proven hands-on experience in Cloudera NiFi production environments and modern data pipeline architecture.

Preferred Qualifications

• Experience with: Cloudera ecosystem technologies (e.g., Kafka, HDFS, Hive, Iceberg), CI/CD practices for data pipelines, monitoring and tuning distributed data platforms, cloud and hybrid data architectures.
• Familiarity with Agile methodologies and DevOps practices.
• Advanced certifications or specialized training.
• Prior experience working in enterprise data platform or consulting environments.

Work Environment & Location:

• Location: Remote
• Collaborative team environment with opportunities for professional growth.

Encore Talent Solutions is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills, and experiences within our workforce.