Welcome to my Cliche… The advent of Big data no doubt has proliferated the need for Data Engineers. But what is Big data? They are data with 3 V’s and can’t be processed by traditional method. The 3 V’s are: Volume(large like Gigabytes,Pb..), Velocity (frequent, stream, real-time…) Variety ( different formats like csv, parquet, audio, video..) This kind of data needs specialized infrastructures, Schema, Storage, Processing tools, automation & monitoring.

Recommendation system is a NLP-based Machine learning project used to predict customer’s interest and items they might like. This is based on a lot of things like customer’s purchase history, purchased item’s categories, search or viewed items categories, item-item similarities, user-user similarities, CONTENT-BASED et cetera. This system has solved a lot problems and it’s been used widely by big sites like Amazon, Ebay, Facebook, Youtube, Netflix E.T.C There are different types of reccomender systems and each of them serve different purpose best.