Search Results

Modelling & Machine Learning (ML) Content

Modeling and Machine Learning

The main difference between modeling and machine learning is that modeling relies on predefined mathematical or statistical formulas to explain relationships in data, while machine learning automatically learns patterns from data without explicit programming. Modeling is often based on assumptions and is more interpretable, whereas machine learning is data-driven, flexible, and excels in handling complex, large-scale, and unstructured data like images and text.

There are two approaches in Machine Learning and Modeling Supervised and Unsupervised

In supervised learning, the data is typically divided into three subsets:
- Training Data: Used to train the model.
- Validation Data: Used during training to tune hyperparameters and evaluate the model’s performance to prevent overfitting.
- Test Data: Used after training to evaluate the final performance of the model on unseen data.
While in unsupervised learning:
- The entire dataset is often used for training because there are no predefined labels.

Supervised and Unsupervised Machine Learning Algorithms

Examples of Supervised and Unsupervised Models

Learning Curve

Some Examples of Modeling Models that you will come across in my notebooks

→ 𝗥𝗲𝗴𝗿𝗲𝘀𝘀𝗶𝗼𝗻 𝗺𝗼𝗱𝗲𝗹𝘀

1️⃣ 𝗟𝗶𝗻𝗲𝗮𝗿 𝗿𝗲𝗴𝗿𝗲𝘀𝘀𝗶𝗼𝗻
Linear Regression models predict a continuous output variable based on one or more input features. This model assumes there's a linear relationship between the input and output variables.
2️⃣ 𝗟𝗼𝗴𝗶𝘀𝘁𝗶𝗰 𝗿𝗲𝗴𝗿𝗲𝘀𝘀𝗶𝗼𝗻
Logistic regression predicts the probability of an outcome that can only have two values, like yes/no, 1/0. We typically also put a threshold on the predicted probability to determine the predicted classification

→ 𝗧𝗿𝗲𝗲 𝗺𝗼𝗱𝗲𝗹𝘀

3️⃣ 𝗗𝗲𝗰𝗶𝘀𝗶𝗼𝗻 𝘁𝗿𝗲𝗲
Decision tree models look like flow charts; they help us make decisions based on a series of questions or input variables. Decision trees can be used to classify data or predict continuous outcomes.
4️⃣ 𝗥𝗮𝗻𝗱𝗼𝗺 𝗳𝗼𝗿𝗲𝘀𝘁
Random Forest combines multiple decision trees to make predictions. It creates many decision trees using random subsets of the data and features. This approach helps reduce overfitting and improves generalization.

→𝗖𝗹𝘂𝘀𝘁𝗲𝗿𝗶𝗻𝗴 𝗺𝗼𝗱𝗲𝗹𝘀

5️⃣ 𝗛𝗶𝗲𝗿𝗮𝗿𝗰𝗵𝗶𝗰𝗮𝗹 𝗰𝗹𝘂𝘀𝘁𝗲𝗿𝗶𝗻𝗴
Hierarchical Clustering is an unsupervised model that builds a tree-like structure of clusters. They can be built from bottom up (each data point starts in its own cluster and clusters are merged as you move up the hierarchy) or top down (where all data starts in one cluster and splits occur as you move down the hierarchy).

→ 𝗜𝗻𝘀𝘁𝗮𝗻𝗰𝗲-𝗯𝗮𝘀𝗲𝗱 𝗺𝗼𝗱𝗲𝗹𝘀

6️⃣ K-nearest neighbors KNN predicts outputs by finding the K most similar data points to a new input, and using their outputs to make a prediction. KNN is non-parametric, meaning it doesn't make assumptions about the underlying data distribution.

Some Examples of Machine learning Models that you will come across in my notebooks

1️⃣𝗞-𝗺𝗲𝗮𝗻𝘀 𝗰𝗹𝘂𝘀𝘁𝗲𝗿𝗶𝗻g
K-means Clustering is an unsupervised model that groups similar data points into K clusters based on their features. It aims to minimize the distance between each data point and the cluster center.
2️⃣Principal Component Analysis (PCA)
It is an unsupervised statistical model primarily used for dimensionality reduction and feature extraction. Rather than making predictions, PCA transforms high-dimensional data into a smaller set of uncorrelated components (principal components) that retain most of the original data's variance.

1. LINEAR REGRESSION MODEL

• Linear regression with one variable using Scikit-learn
• Linear regression with multiple variables
• Using categorical features for machine learning
• Regression coefficients and feature importance
• Other models and techniques for regression using Scikit-learn
• Applying linear regression to other datasets

2. LOGISTIC REGRESSION MODEL

• Exploratory data analysis and visualization
• Splitting a dataset into training, validation & test sets
• Filling/imputing missing values in numeric columns
• Scaling numeric features to a range
• Encoding categorical columns as one-hot vectors
• Training a logistic regression model using Scikit-learn
• Evaluating a model using a validation set and test set
• Saving a model to disk and loading it back

3. DECISION TREES & RANDOM FOREST MODELS

• Preparing a dataset for training
• Training and interpreting decision trees
• Training and interpreting random forests
• Overfitting & hyperparameter tuning
• Making predictions on single inputs

4. GRADIENT BOOSTING MODEL

• Downloading a real-world dataset from a Kaggle competition
• Performing feature engineering and prepare the dataset for training
• Training and interpreting a gradient boosting model using XGBoost
• Training with KFold cross validation and ensembling results
• Configuring the gradient boosting model and tuning hyperparameters

References

Scikit-learn

Deep Learning for Computer Vision Content

What is deep learning?

Deep learning is a subset of machine learning that uses multilayered neural networks, called deep neural networks, to simulate the complex decision-making power of the human brain. Some form of deep learning powers most of the artificial intelligence (AI) applications in our lives today. The difference between deep learning and machine learning is the structure of the underlying neural network architecture. “Nondeep,” traditional machine learning models use simple neural networks with one or two computational layers. Deep learning models use three or more layers—but typically hundreds or thousands of layers—to train the models. Deep learning is an aspect of data science that drives many applications and services that improve automation, performing analytical and physical tasks without human intervention. This enables many everyday products and services—such as digital assistants, voice-enabled TV remotes, credit card fraud detection, self-driving cars and generative AI.

Face Detection with MTCNN (Multi-Task Cascaded Convolutional Networks)

NoteBook_1

NoteBook_2



NoteBook_3



NoteBook_4


Medical Data



Generative and Discriminative Models



Medigan, Generative and Discriminative Models


Traffic Data



Traffic Detection


YOLO Model

References

• Pytorch Tutorial

Machine Learning Projects

1. Customer Churn Dataset

Dataset Description

Customer churn refers to the phenomenon where customers discontinue their relationship or subscription with a company or service provider. It represents the rate at which customers stop using a company's products or services within a specific period. Churn is an important metric for businesses as it directly impacts revenue, growth, and customer retention. In the context of the Churn dataset, the churn label indicates whether a customer has churned or not. A churned customer is one who has decided to discontinue their subscription or usage of the company's services. On the other hand, a non-churned customer is one who continues to remain engaged and retains their relationship with the company. Understanding customer churn is crucial for businesses to identify patterns, factors, and indicators that contribute to customer attrition. By analyzing churn behavior and its associated features, companies can develop strategies to retain existing customers, improve customer satisfaction, and reduce customer turnover. Predictive modeling techniques can also be applied to forecast and proactively address potential churn, enabling companies to take proactive measures to retain at-risk customers.

My Project in Logistic Regression, Decision Trees & Random Forest Models

Kaggle Competation

2. Predict the Introverts from the Extroverts

Dataset Description

The dataset for this competition (both train and test) was generated from a deep learning model trained on the Extrovert vs. Introvert Behavior dataset. Feature distributions are close to, but not the same as, the original. Feel free to use the original dataset as part of this competition, both to explore differences and to see whether incorporating the original in training improves model performance.

Note – This is a relatively small dataset, so one to use for comparing different modeling approaches, making visualization, etc.

Files

• train.csv – the training dataset; Personality is the categorical target
• test.csv – the test dataset; your objective is to predict the Personality for each row
• sample_submission.csv – a sample submission file in the correct format

Predict the Introverts from the Extroverts

Kaggle Competation

3. Regression of Used Car Prices

Dataset Description

About the Tabular Playground Series

The goal of the Tabular Playground Series is to provide the Kaggle community with a variety of fairly light-weight challenges that can be used to learn and sharpen skills in different aspects of machine learning and data science. The duration of each competition will generally only last a few weeks, and may have longer or shorter durations depending on the challenge. The challenges will generally use fairly light-weight datasets that are synthetically generated from real-world data, and will provide an opportunity to quickly iterate through various model and feature engineering ideas, create visualizations, etc.

Synthetically-Generated Datasets

Using synthetic data for Playground competitions allows us to strike a balance between having real-world data (with named features) and ensuring test labels are not publicly available. This allows us to host competitions with more interesting datasets than in the past. While there are still challenges with synthetic data generation, the state-of-the-art is much better now than when we started the Tabular Playground Series two years ago, and that goal is to produce datasets that have far fewer artifacts. Please feel free to give us feedback on the datasets for the different competitions so that we can continue to improve!

Files

• train.csv – the training dataset
• test.csv – the test dataset
• sample_submission.csv – a sample submission file in the correct format

Regression of Used Car Prices

Welcome,

LIKE & FOLLOW MY FACEBOOK PAGE

I am a freelancer in data science, and I offer free data analysis materials in Python. First, I will introduce you to coding in Python. After you gain some skills, I will guide you through data analysis and visualization in Python, step by step.

We start here, introduction to coding in Python, this will help you have sufficient skills to venture into data analysis with Python

1. INTRODUCTION TO PROGRAMMING IN PYTHON

• First steps with Python & Jupyter notebooks
• Arithmetic, conditional & logical operators in Python
• Quick tour with Variables and common data types

2. VARIABLES AND DATA TYPES IN PYTHON

• Storing information using variables
• Primitive data types in Python: Integer, Float, Boolean, None, and String
• Built-in data structures in Python: List, Tuple, and Dictionary
• Methods and operators supported by built-in data types

3. BRANCHING AND LOOPING IN PYTHON

• Branching with if, else, and elif
• Nested conditions and if expressions
• Iteration with while loops
• Iterating over containers with for loops
• Nested loops, break and continue statements

4. REUSABLE CODE USING FUNCTIONS IN PYTHON

• Creating and using functions in Python
• Local variables, return values, and optional arguments
• Reusing functions and using Python library functions
• Exception handling using try-except blocks
• Documenting functions using docstrings

5. COMPUTING WITH NUMPY IN PYTHON

• Working with numerical data in Python
• Going from Python lists to Numpy arrays
• Multi-dimensional Numpy arrays and their benefits
• Array operations, broadcasting, indexing, and slicing
• Working with CSV data files using Numpy

6. ANALYZING WITH PANDAS AND VISUALIZATION IN PYTHON

• Reading a CSV file into a Pandas data frame
• Retrieving data from Pandas data frames
• Querying, sorting, and analyzing data
• Merging, grouping, and aggregation of data
• Extracting useful information from dates
• Basic plotting using line and bar charts
• Writing data frames to CSV files

7. USING MATPLOTLIB AND SEABORN

• Creating and customizing line charts using Matplotlib
• Visualizing relationships between two or more variables using scatter plots
• Studying distributions of variables using histograms & bar charts
• Visualizing two-dimensional data using heatmaps
• Displaying images using Matplotlib's plt.imshow
• Plotting multiple Matplotlib and Seaborn charts in a grid

Data Analysis with Python

Afcon Analysis in Python

• This project involves analysis of the Africa Cup of Nations games that have been played from 1957 to 2022

Bike Store Sales Aanlysis

• This project involves analysis of Bike Store Sales in Europe

Come Try this Project with Me

• The data in this notebook contains the exchange rate of the Kenyan shilling against the US dollar from 1991 to 2024
• Try to come with some insights like factors that cause the Kenyan shilling to depreciate when subjected to the US dollar
• Presidency regime that affected the Kenyan shilling so much
• Remember you don't need to install Python and Anaconda to do this project since I have integrated an IDE from Google called COLAB
• Click the colab and it will allow you to run your code on this notebook
• I am also doing the same project, let's learn together

Comming very soon...!

A project On Kenya Online Market

Kenya Online Markets

This project showcases a responsive e-commerce platform built using modern web technologies, focusing on user experience and efficient product display.

Irura Jackson Mwongera

is a Mathematician specialized in Data Science/Data Analytics with knowledge in website/system development.

Note:

THIS WEBSITE WAS DESIGNED AND CREATED BY

[Irura Jackson Mwongera System/Website Design/Data Science Ltd]

Irura's Bio

Irura Jackson Mwongera is a diligent and versatile professional with extensive experience in data science, data analysis, web development, and data annotation.Irura's academic background includes a Bachelor of Science in Mathematics with Information Technology, specializing in statistics, from Masinde Muliro University of Science and Technology. He possesses a diverse skill set, including website front-end development (HTML, CSS, JavaScript), database management (MySQL, SQL), data analysis and visualization (Python, SQL, Excel, and Power BI), technical writing, data annotation, Machine Learning and deep learning for computer vision. His practical knowledge extends to basic computer maintenance, IT equipment installation, and data backup, making him a well-rounded and resourceful professional.In his personal life, Irura enjoys coding in Python, web development, watching football, socializing, researching, traveling, and seeking adventure. His hobbies reflect his curiosity and enthusiasm for continuous learning and exploration.

MY DATA SCIENCE & DATA ANALYTICS

Badges and Certificates

ALX AFRICA

Certificate For Professional Foundations

ALX AFRICA

Data Analytics

WorldQuant University

Applied Data Science Lab

WorldQuant University

Applied AI Lab: Deep Learning for Computer Vision

JOVIAN

Data Analysis in Python

JOVIAN

Machine Learning with Python

Services Offered:

• Advanced Data Analysis & Statistical Modeling:

  Leveraging Python, SQL, and Excel, I conduct in-depth data analysis, including trend forecasting, impact assessment, and the interpretation of complex datasets.

• Business Intelligence (BI) Dashboard Development:

  I design, configure, and maintain interactive dashboards using Power BI to provide real-time insights into project performance, marketing trends, and operational metrics, enabling data-driven strategic planning.

• Machine Learning & Predictive Analytics:

  Specializing in Python, I develop and implement various machine learning models, including Linear and Logistic Regression, Decision Trees, Random Forests, and Gradient Boosting, for predictive analytics and data-driven solutions. I also work with unsupervised models like K-means Clustering and PCA for data insights.

• Deep Learning for Computer Vision:

  I apply deep learning techniques for advanced computer vision tasks, including face detection using MTCNN and working with generative and discriminative models for medical data and traffic detection.

• Database Management & Optimization (SQL/MySQL):

  I provide services for setting up, managing, and optimizing relational databases using MySQL and SQL, ensuring efficient data storage, retrieval, and integrity.

• IT Support & System Administration:

  Offering comprehensive IT support, including troubleshooting hardware, software, and network issues, implementing IT policies, ensuring data security, and automating workflows. This also covers user account provisioning and deactivation processes.

• Digital Marketing Strategy & Analytics:

  I assist businesses in developing data-driven marketing strategies by monitoring sales trends, assessing campaign effectiveness, conducting market research, and providing advice on web analytics, PPC, and content marketing.

• Data Annotation Services:

  Providing precise data annotation for various data types, including text, image, video, audio, and LiDAR, is essential for training machine learning and deep learning models.

Contact Us

Goooooooogle Workspace Skills are essential to every professional in todays life

Browse the link below and see if you have all these skills

• Gmail
• G - Calender
• G - Drive
• G - Docs
• G - Sheets
• G - Slides
• G - Forms

Open Google Sheets

Now,if you feel you lack the above Essential google Skills

,

• Send me you email through irura.mwongera11@gmail.com,,,I will allow you to open the link below with answers
• @ 200 Ksh

You will become pro to all these in just one week

• Gmail
• G - Calender
• G - Drive
• G - Docs
• G - Sheets
• G - Slides
• G - Forms

Open Google Sheets