BostonRecruiter Since 2001
the smart solution for Boston jobs

Big data engineer

Company: Schneider Electric USA, Inc
Location: Andover
Posted on: May 16, 2022

Job Description:

Schneider Electric is the global specialist in energy management and automation. With revenues of -25 billion in FY2018, our 144,000 employees serve customers in over 100 countries, helping them to manage their energy and process in ways that are safe, reliable, efficient and sustainable. From the simplest of switches to complex operational systems, our technology, software and services improve the way our customers manage and automate their operations. Our connected technologies reshape industries, transform cities and enrich lives. At Schneider Electric, we call this Life Is On . Schneider Electric is leading the Digital Transformation of Energy Management and Automation in Homes, Buildings, Data Centers, Infrastructure and Industries.With global presence in over 100 countries, Schneider is the undisputable leader in Power Management - Medium Voltage, Low Voltage and Secure Power, and in Automation Systems. We provide integrated efficiency solutions, combining energy, automation and software. In our global Ecosystem, we collaborate with the largest Partner, Integrator and Developer Community on our Open Platform to deliver real-time control and operational efficiency. We believe that great people and partners make Schneider a great company and that our commitment to Innovation, Diversity and Sustainability ensures that Life Is On everywhere, for everyone and at every moment. Schndier Electric is looking for a big data engineer to join big data platform team located in Boston region, MA. As part of the data platform team, you will be responsible for developing, testing , deploying and maintaining big data platform components and big data solutions. As a big data engineer, you'll work on collecting, storing, processing, and analyzing of huge sets of data and make this data easily accessible across the company and usable in multiple different projects. Duties and responsibilities Use big data technologies to develop distributed, fault-tolerant scalable data solultions. Collect and process data at scale from a variety of sources for different project needs . Participate in identifying, evaluating, selecting and integrating big data frameworks and tools required for the big data platform . Design , develop , and maintain data pipelines , data platforms using selected frameworks and tools based on requirements from different projects. Convert structured and unstructured data in to the form that is suitable for processing. Provide support to different teams in analysizing data. Design, develop and maintain data API's. Integrate data from variety of data sources using federation techniques. Develop solutions independently based on high-level design and architecture with minimal supervision. Monitor the performance of the big data platform on a regular basis and tune the infrastructure and platform components accordingly to ensure the best performance. Maintain a high level of expertise in data technologies and stay current on latest data technologiess . Overall 7 year experience in software development. 3 years of experience in data engineering. Prior experience with implementing big data platform components that are scalable, high performing, and lower in operations cost. Proven experience with integration of data from multiple heterogeneous and distributed data sources. Experience with processing large amounts of data (structured and unstructured. Experience in production support and troubleshooting. Hands-on knowledge of containers, API designing and implementing is a must. Experience with NoSQL databases, Graph databases, relataional databases, time series databases. Excellent knowledge of various ETL techniques and frameworks, various messaging systems, stream-processing systems, Big data ML toolkits, big data querying tools Experience in Python, Go, Perl, Javascript, Kafka, Spark, Kubernetees. Good knowledge of Agile software development methodology. Excellent interpersonal, communication (verbal and written) skills. Proven experience in managing and working with teams based in multiple geograhies. Bachelor's Degree or higher in Computer Science or a related field.

Keywords: Schneider Electric USA, Inc, Boston , Big data engineer, Engineering , Andover, Massachusetts

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest Massachusetts jobs by following @recnetMA on Twitter!

Boston RSS job feeds