DataSpoof

Important Interview Question On Spark ========================================= 1. Difference between RDD & Dataframes 2. What are the challenges you face in spark? 3. What is difference between reduceByKey & groupByKey? 4. What is the difference between Persist and Cache? 5. What is the Advantage of a Parquet File? 6. What is a Broadcast Join ? 7. What is Difference between Coalesce and Repartition? 8. What are the roles and responsibility of driver in spark Architecture? 9. What is meant by Data Skewness? How is it deal? 10. What are the optimisation techniques used in Spark? 11. What is Difference Between Map and FlatMap? 12. What are accumulator and BroadCast Variables? 13. What is a OOM Issue, how to deal it? 14. what are tranformation in spark? Type of Transformation? 15. Tell me some action in spark that you used ? 16. What is the role of Catalyst Optimizer ? 17. what is the checkpointing? 18. Cache and persist 19. What do you understand by Lazy Evaluation ? 20. How to convert Rdd to Dataframe? 21. How to Dataframe to Dataset. 22. What makes Spark better than Hadoop? 23. How can you read a CSV file without using an external schema? 24. What is the difference between Narrow Transformation and Wide Transformation? 25. What are the different parameters that can be passed while Spark-submit? 26. What are Global Temp View and Temp View? 27. How can you add two new columns to a Data frame with some calculated values? 28. Avro Vs ORC, which one do you prefer? 29. What are the different types of joins in Spark? 30. Can you explain Anti join and Semi join? 31. What is the difference between Order By, Sort By, and Cluster By? 32. Data Frame vs Dataset in spark? 33. 4.What are the join strategies in Spark 34. What happens in Cluster deployment mode and Client deployment mode 35. What are the parameters you have used in spark-submit 36. How do you add a new column in Spark 37. How do you drop a column in Spark 38. What is difference between map and flatmap? 39. What is skew partitions? 40. What is DAG and Lineage in Spark? 41. What is the difference between RDD and Dataframe? 42. Where we can find the spark application logs. 43. What is the difference between reduceByKey and groupByKey? 44. what is spark optimization? 45. What are shared variables in spark 46. What is a broadcast variable 47. Why spark instead of Hive 48. what is cache 49. Tell me the steps to read a file in spark 50. How do you handle 10 GB file in spark, how do you optimize it

https://www.instagram.com/p/C2JX6tdvUAj/?igsh=MWk3MGpwdnJpbTd4cQ== Follow on Instagram for more data science content

Roadmap of learning tableau

Heros of deep learning (CNN)- Yann lecun

All YouTube Resources for DSA 🔥🔥 Important topic-wise playlist on youtube [BEST]💯💯 DSA full course-https://lnkd.in/drfYia2j ARRAYS - https://lnkd.in/dG69DAEZ STRING - https://lnkd.in/deWr9svh Dynamic Programming-https://lnkd.in/dGpVEHg8 Recursion-https://lnkd.in/dv6XUNyP Heap-https://lnkd.in/dZBJdr2W SLIDING WINDOW -https://lnkd.in/dxXNKFgQ Binary Search-https://lnkd.in/dCQRSiXq Stack-https://lnkd.in/dYqeH7ft HASHING -https://lnkd.in/dM77crfV Binary Trees-https://lnkd.in/dFSXYYFt Graph-https://lnkd.in/dfmi74sU TRIE -https://lnkd.in/d3e-wm_J SEGMENT TREE -https://lnkd.in/dytGUaGB COMPETITIVE PROGRAMMING ->(https://lnkd.in/d3z6jKE4)

https://www.linkedin.com/posts/abhishek-kumar-singh-8a6326148_artificialintelligenceai-learncode-programmingmemes-activity-7148193868826431488-sg_l?utm_source=share&utm_medium=member_android Roadmap for Microservices

Top 10 Leetcode Articles to identify patterns in DSA 🔥 : 1) Sliding Window Pattern : https://lnkd.in/gPZDh9Er 2) Two Pointers Pattern : https://lnkd.in/gd7mrf_D 3) Substring Problems Pattern : https://lnkd.in/gkAipSuF 4) Dynamic Programming-1 Pattern : https://lnkd.in/gjkjTwHD 5) Dynamic Programming-2 Pattern : https://lnkd.in/gNKrm_5N 6) Binary Search Pattern : https://lnkd.in/gSwxE2WN 7) Tree Pattern : https://lnkd.in/gmPEVK6v 8) Graph Pattern : https://lnkd.in/gNTrMUKb

Sql injection for data science