Machine Learning Featured Providing Context to Large Language Models using VectorDB Using VectorDB to increase effectiveness of Large Language Models (LLMs) in enterprise use cases
Software Engineering Engineering Management is not Easy I have discussed the path to engineering management with a few people in the last few months. Most of these conversations were productive, but some of the statements had me wondering about the misconception folks have about engineering managers. Here is a sample of some puzzling statements that came up
Engineering Culture Traits of Highly Successful Teams I have worked for 10 people startups, to mid-size hyper growth companies, to a Fortune 500 company. In each of those opportunities, I was surrounded by smart people. Yet some teams were highly successful while the others struggled with their goals. Reflecting back on those times, I was analyzing why
Software Engineering Effective Sprint Planning - Five Things to Consider Anyone who knows me, knows my general dislike about scrum methodologies. But Scrum is everywhere and some are even following it as a religion. Well, if we are continuing this cultish ideology, let me help a bit. Here are the things that I think teams should consider right before committing
Software Engineering Apple ID - Lost Email Account and Forgotten Security Answers I recently upgraded my macbook to Mojave. While browsing some settings in my system preferences, I noticed that my icloud account was linked to my old Apple ID which was linked to my ancient Yahoo account (yes, don't judge). I tried to sign out of that account and that's where
Engineering Culture Don't Leave Tech Just Yet Disclaimer: The thoughts below are mine and not of my present or past employers'. I have not been compensated or asked to write this article. I am just crossing the 10 years mark of my career in the software industry. With that milestone, I have been thinking to write about
Travel Stories Countries Visited India, US, UAE, Australia, Singapore, New Zealand, Japan, Costa Rica, Taiwan, Dominican Republic, Mexico, Ireland
Devops Data Science in Production There is a lot that goes behind developing a model such as data cleaning, analysis, statistics, modeling, accuracy analysis etc. Even with all that, developing a model is just the tip of the iceberg when it comes to delivering a machine learning solution in production. I spoke at OSCON 2018
Machine Learning Serving Athletes* with Personalized Workout Recommendations My post on Workout Recommender system is now up on the Nike Engineering blog - https://medium.com/nikeengineering/serving-athletes-with-personalized-workout-recommendations-285491eabc3d The post provides insight into the Science and Engineering behind the machine learning system that powers the personalized recommendations in Nike Training Club app. Check it out and share your
Apache Spark Tuning Spark Jobs on EMR with YARN - Lessons Learnt Apache Spark is a distributed processing system that can process data at a very large scale. Even though Spark's memory model is optimized to handle large amount of data, it is no magic and there are several settings that can give you most out of your cluster. I am summarizing
Engineering Culture Is She Even a Developer? It has been 6 years since I overheard this question/comment about me. My co-workers were reviewing my pull request. One of them got frustrated and thought that it was appropriate to discuss the authenticity of my Computer Science background. I overheard his comment and also the laughter of the
AWS Cross-Account S3 bucket settings for data transfer on Hadoop based systems While trying to write some data from one AWS account to another, I ran into several cross-account S3 settings issues. Google was coming out thin on my searches, hence documenting it in case somebody else runs into this. Problem Account 1 (let's call it Dumbledore) has a S3 Bucket. Account
Machine Learning Strata + Hadoop 2016 Conference in NY This past September, Nike approved my request to attend the Strata + Hadoop Conference [http://conferences.oreilly.com/strata/hadoop-big-data-ny] in New York. Strata is one of the biggest conferences for Engineers who are interested in Machine Learning and Big Data. The three day long conference covered various workshops and sessions
AWS Migrating to EMR 5.0.X for Spark 2.0 AWS released EMR 5.0 recently. It is a major release and contains upgrades such as Apache Spark 2.0, Apache Hive 2.1, Presto 0.150, Apache Zeppelin 0.6.1 etc Spark 2.0 comes with various performance and API updates. There are also some breaking changes that
