Data Engineer

NYSTEC has a job opening for a data engineer. Are you ready to contribute to our engaged workforce and to deliver the NYSTEC Experience?

Department: Information Technology
Location: Albany, NY
Salary: $91,761.00 to $126,172.20 Per Year

About Us

NYSTEC is a nonprofit technology consulting company, advising agencies, organizations, institutions, and businesses since 1996. We’re independent and vendor-neutral, so we have our clients’ best interests at heart. At NYSTEC, we know that we succeed when individuals and teams flourish personally and professionally, so our benefits and perks support that mindset.

About the Data Engineer Role

As a data engineer in the information technology department, you will collaborate with team members to work on innovative projects and be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. The role will collaborate closely with cross-functional teams to ensure the availability, reliability, and performance of NYSTEC data systems and solutions.

Key Responsibilities: Data Engineer

Overall, in the role of data engineer, you will:

• Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses.
• Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions.
• Ensure data integrity, quality, and governance throughout Microsoft Fabric environments.
• Collaborate with stakeholders, analysts, and architects to translate business needs into actionable data solutions.
• Troubleshoot and optimize existing Microsoft Fabric implementations for enhanced performance.
• Test, monitor, and ensure compliance with best practices in data analytics and quality management.

Required Qualifications: Data Engineer

Candidates applying for the role of data engineer should have the following knowledge, skills, and/or abilities:

• Experience translating business requirements to technical requirements.
• Proficiency in programming languages commonly used in data engineering (e.g., Python, Java, Scala).
• Strong knowledge of database systems, data modeling techniques, and SQL proficiency.
• Proficiency with ETL tools commonly used in data engineering (e.g., SSIS, Databricks, Azure Data Factory).
• Strong working knowledge and experience with Microsoft Azure services and tools including Microsoft Fabric, Azure Data Factory, Azure Synapse, Azure SQL Database, and Azure Databricks.
• Experience using a work management tool such as Azure DevOps.

Preferred/Desired Qualifications: Data Engineer

It would be helpful for candidates applying for the data engineer role to have the following knowledge, skills, and/or abilities:

• Microsoft Certified: Fabric Data Engineer Associate.
• Microsoft Certified: Fabric Analytics Engineer Associate.

Education and Experience: Data Engineer

For the data engineer, candidates should have the following education/experience:

• Bachelor’s degree in computer science, engineering, information systems, or related field. Master’s degree preferred. A minimum of five years of experience in information technology with at least two years of the following.
• Experience in business analytics, data science, software development, data modeling, or data engineering work or equivalent experience.
• Experience manipulating and transforming data in Spark SQL, PySpark, or Spark Scala, or a minimum of two years of experience manipulating and transforming data in T-SQL.

Equal Employment Opportunity (EEO)

It is NYSTEC’s policy to provide equal employment opportunity (EEO) to all individuals, regardless of actual or perceived race, color, creed, religion, sex or gender (including pregnancy, childbirth, and related medical conditions), gender identity or gender expression (including transgender status), age, national origin, ancestry, citizenship status, physical or mental disability, protected medical condition as defined by applicable state or local law, genetic information, military service and veteran status, sexual orientation, marital status, or any other characteristic protected by local, state, or federal laws and ordinances. NYSTEC is strongly committed to this policy and believes in the concept and spirit of the law.

Reasonable Accommodations

Federal law requires employers to provide reasonable accommodation to qualified individuals with disabilities. Please contact Talent_Management-Confidential@nystec.com if you require a reasonable accommodation to apply for a job or to perform your job. Examples of reasonable accommodation include making a change to the application process or work procedures, providing documents in an alternate format, using a sign language interpreter, or using specialized equipment.

Work Authorization

Applicants must be authorized to work in the United States without the need for visa sponsorship now or in the future.

Learn More about NYSTEC

Interested in NYSTEC’s culture and values? Find out what it’s like to be a NYSTECer.

Apply Today

If you’re an effective communicator who enjoys working in complex and collaborative environments, using your critical thinking and research skills to develop solutions for clients, and providing support to customers, we want to hear from you.

Do work that matters.

Start Your Application