Role & Company Overview
📋 Role Overview & Responsibilities
Data EngineerLocation: Newark - Washington St. Contract to Hire - (USC/GC) Only(Hybrid 2-3 days onsite per week) ResponsibilitiesImplement and support:end-to-end data lake/warehousing/mart/business intelligence/ analytics/ services solutions (ingest, storage, integration, processing, services, access) in AWSdata lake data intake/request/onboarding services and service documentationdata lake ingestion services for batch/real time data ingest and service documentationdata processing services (ETL/ELT) for batch/real time (Glue/Kinesis/EMR) and service documentationdata storage services for data lake (S3)/ data warehouses (RDS/Redshift)/ data marts and service documentationdata services layer including Athena, Redshift, RDS, microservices and APIspipeline orchestration services including lambda, step functions, MWAA (optional)data security services (IAM/KMS/SM/encryption/anonymization/RBAC) and service documentationdata access provisioning services (Accounts, IAM Roles RBAC), processes, documentation and educationdata provisioning services for data consumption patterns including microservices, APIs and extractsmetadata capture and catalog services for data lake(S3/Athena), data warehouses (RDS/Redshift), Microservices/APIsmetadata capture and catalog services for pipeline/log data for monitoring /supportImplement CI/CD pipelines Prepare documentation for data projects utilizing AWS based enterprise data platformImplement high velocity streaming solutions using Amazon Kinesis, SQS, and SMSMigrate data from traditional relational database systems to AWS relational databases such as Amazon RDS, Aurora, and RedshiftMigrate data from traditional file systems and NAS shares to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and RedshiftMigrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and RedshiftProvide cost/spend monitoring reporting for AWS based data platform data initiatives Provide governance/audit reporting for access of AWS based data platformLead the implementation of a data lake strategy to enable LOBs and Corporate Functions with a robust, holistic view of data - driven decision makingServe as delivery lead for EDP data initiatives product ownerPartner with immediate engineering team, product owner, IT, partners on EDP agendaProvide technology thought leadership, consulting, and coaching/mentoringEstablish development, qa, stage and production migration/support processesEstablish best practices for development and support teamsDeliver end-end data initiatives from ingest-consume via microservices/ apis, jdbc/ odbc, file extracts etc. Work with scrum master to develop and own backlog, stories, epics, sprints
Qualifications :Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experienceExperience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprisesProgramming experience with Java, Python/ Scala, Shell scriptingSolid experience of AWS services such as CloudFormation, S3, Glue, EMR/ Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc. Solid experience implementing solutions on AWS based data lakesExperience implementing metadata solutions leveraging AWS non-relational data solutions such as ElastiCache and DynamoDBAWS Solutions Architect or AWS Big Data Certification preferredExperience in AWS data lake/data warehouse/business analyticsExperience and understanding of various core AWS services such as IAM, Cloud Formation, EC2, S3, EMR/Spark, Glue, Datasync, CloudHealth, CloudWatch, Lambda, Athena, and RedshiftExperience in system analysis, design, development, and implementation of data ingestion pipeline in AWSExperience with DevOps and Continuous Integration/ Delivery (CI/ CD) concepts and toolsExperience with business intelligence tools such as Tableau, Power BI or equivalentKnowledge of ETL/ ELTExperience in production support from Level 1 to Level 3Awareness of Data Management & Governance toolsWorking experience with Hadoop, HDFS, SQOOP, Hive, Python, and Spark is desired Experience working on Agile projects
RegardsSai KiranSaikiran@techtriad.com
Frequently Asked Questions
How do I apply for the Data Engineer position at TechTriad? ▼
Click the “Apply for this Position” button on this page to submit your application directly to TechTriad without recruitment intermediary fees.
Is this position eligible for remote work or visa sponsorship? ▼
This position is located in Newark, NJ with potential relocation and sponsorship assistance depending on candidate qualifications.
Are there any candidate fees on Hirely? ▼
No. Hirely is completely free for candidates. We never charge registration fees or placement fees.
Legitimate employers will never ask you to transfer funds, purchase equipment from unauthorized vendors, or pay application/visa fees. Hirely rigorously monitors listings, but always verify communication is from official corporate email domains.
Learn how to protect yourself against employment fraud