Spark Developer
Through knowledge on Scala Programming
Should lead and guide a team of Spark developers
Implementation of Spark Core, Spark SQL and Spark Streaming
Experience on Apache Kafka Integration with Apache Spark
Implementing security for Spark Applications
Working with Spark in combination Hadoop Ecosystem
Good working knowledge on Hive
Developing Hive UDF's in Python or Java and integrating with Spark
Should able able to understand spark implementation in various environments such as Standalone, Yarn and Meso's
Integrating Spark with NoSQL databases such as Cassandra, MongoDB (at least one is mandatory)
Working with Apache Kafka
Should be able to fine tune performance of Spark applications
Knowledge on Cloud, AWS etc - Hands on Desirable
Programming knowledge in Java, Python - Desirable
Good knowledge on RDBMS such as MySQL. Oracle, PostGRE and interacting with these database from Spark
Knowledge on one domain such as Telecom/Media etc
Guiding team on Implementing coding standards, preparing technical documentation and other related activities
Good understanding of Hadoop Ecosystem components such as Pig, Oozie, Sqoop, Impala, Kudu, Tez
Should be able to quickly learn and guide team on new developments in Spark, BigData and NoSQL DBs.
Good understanding of Spark core concepts is a must.
Hands on experience of about 3 years on Scala/PySpark programming is a must.
Hands on experience in SparkSQL is a must.
Knowledge on NoSql DBs would be an advantage.
Address: Special Economic Zone, Tower - I, Plot No. 22 to, 34, Hitech City Rd, Jubilee Enclave, Madhapur, Hyderabad, Telangana 500081
Phone: 040 3063 6363
Email: [email protected]