Dell Senior Advisor, Data Engineering in Hyderabad, India
Job Title: Senior Advisor, Data Engineering (I8)
Data Science is all about breaking new ground to enable businesses to answer their most urgent questions. Pioneering massively parallel data-intensive analytic processing, our mission is to develop a whole new approach to generating meaning and value from petabyte-scale data sets and shape brand new methodologies, tools, statistical methods and models. What’s more, we are in collaboration with leading academics, industry experts and highly skilled engineers to equip our customers to generate sophisticated new insights from the biggest of big data.
Join us to do the best work of your career and make a profound social impact as a Senior Advisor on our Data Engineering team in India.
What you’ll achieve: As Senior Advisor, you will be responsible for the following:
Ideate, Design, Develop and maintain DATA products and services
Build and leverage new or existing infrastructure, libraries, resources and services with modern software engineering best practices
Build enterprise scale highly reliable data pipelines to handle large data sets with high performance to cement foundations the DATA products
Conceive and ship new data driven products, features, and technologies in short span
Build, Refine and enhance data pipelines to handle 3 V's of Big Data and deliver rich and advanced analytical insights
Handle multi-terabyte/petabyte data volumes
Handle real-time or batch
Handle ingestion of any to no structure (raw, semi or structured data)
Consolidate and clean data from various structured and unstructured sources and integrate them into canonical models
Build each component with security first and CI/CD mindset
Build DATA solutions with reliability, data quality, user experience and automation
Build (BI on BI) tools to manage, automate and monitor our data and data processing infrastructure.
Adopt and re-define Design, coding, testing, packaging, debugging, documentation and deployment of data systems
Develop high-performance code to provide statistics and reports, autonomously deploy and monitor them
Take the first step towards your dream career
Every Dell Technologies team member brings something unique to the table. Here’s what we are looking for with this role:
9 to 12 years of Software Engineering exp with Min. 4+ Years of Python Data Engineering Experience
Strong problem-solving skills
Complete knowledge and understanding of ANSI SQL:2011 is a must (SQL:2016 good to have)
Familiar with nuances of SQL implementation and Database engines of
MPP DB's like Teradata, Greenplum
OLTP DB's like Oracle, SQLServer and Postgres
In-memory DB's like HANA, MemSQL
Hive, HBase and Kudu
Expertise in Data Ingestion and Transformation tools and technologies
Spark(python preferable, scala good to have)
Highly proficient in Python
Has working experience with automated test integration using CI/CD tools
Gitlab preferable(jenkins good to have)
Has working experience of Business Intelligence systems (Looker, BO, Tableau)
Experience with containerization, container orchestration and workflow management
Control-M(preferable)/ AutoSys/ ActiveBatch
Here’s our story; now tell us yours
Dell Technologies helps organizations and individuals build a brighter digital tomorrow. Our company is made up of more than 150,000 people, located in over 180 locations around the world. We’re proud to be a diverse and inclusive team and have an endless passion for our mission to drive human progress.
What’s most important to us is that you are respected, feel like you can be yourself and have the opportunity to do the best work of your life -- while still having a life. We offer excellent benefits, bonus programs, flexible work arrangements, a variety of career development opportunities, employee resource groups, and much more.
We started with computers, but we didn’t stop there. We are helping customers move into the future with multi-cloud, AI and machine learning through the most innovative technology and services portfolio for the data era. Join us and become a part of what’s next in technology, starting today.
You can also learn more about us by reading our latest Diversity and Inclusion Report and our plan to make the world a better place by 2030 here (https://jobs.dell.com/diversity-and-inclusion) .
Dell is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Dell are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Dell will not tolerate discrimination or harassment based on any of these characteristics. Dell encourages applicants of all ages. Read the full Equal Employment Opportunity Policy here (https://jobs.dell.com/equal-employment-opportunity-policy-statement) .
Write high quality, extensible and testable code by applying good engineering practices (TDD, BDD) using Dell/Pivotal's Engineering Practices
A team player who’s able to collaborate with people of various skills and backgrounds
Excited to help bring the rigor of modern software development practices to the business intelligence space
Knowledgeable about data modeling, data access, and data storage techniques
Good programming abilities with a focus on Quality (testing, maintainability, performance…).
Shipped multiple projects in Data Engineering or equivalent field
Strong problem solving skills
Strong communication skills both written and oral, and a great team spirit
Contributed in complex data products
Experience building pipelines with Spark (or similar computation frameworks such as Apache Beam)
Experience in fast prototyping and establishing team engineering best practices is preferred.
Experience with container based deployments such as Docker & Kubernetes.
Experience in building RESTful and microservices applications.
Experience building REST APIs for analytics services
Experience with cluster and configuration management systems such as Docker, Mesos, Marathon, Salt
Familiarity writing and optimizing advanced SQL queries
Good Linux/UNIX systems knowledge