The above is an architecture I am using in crawling the Nepali Websites. I have a list of handpicked websites that serve Nepali content. These websites are added to a databases. If a new domain is identified, that is added to the database. So my link crawler – which is a web tool that goes… Continue reading Architecture for Text Link Crawl | Data Crawl for NLP, Machine Learning
Free Dataset for Nepali Language Machine Learning, Sentiment Analysis etc.
I have decided to publish some of my work related to Machine Learning for free so that other developers and machine learning enthusiasts trying to work in the field of artificial intelligence for Nepali Language do not have to spend a lot of time in the data gathering phase. I will maintain this list with… Continue reading Free Dataset for Nepali Language Machine Learning, Sentiment Analysis etc.
How scanning news meta data is helping me find useful information
It’s been a few years I have worked on trying to utilize data mining, deep learning and artificial intelligence to a good use in Nepal. Here is what I just completed working on. I gathered a list of websites that served News from Nepal, then automated a process to crawl the homepage of these websites… Continue reading How scanning news meta data is helping me find useful information
Exposing the API of my Nepali Natural Language Processing Tool through Swagger
Swagger UI is one of those tools that is very beneficial to the developers to do both documentation of the API as well as be able to play around with the Restful APIs by doing HTTP operations. I have several APIs exposed in the NLP tool that I am writing that exposes a lot of… Continue reading Exposing the API of my Nepali Natural Language Processing Tool through Swagger
Architecture: Nepali Language Crawling, Machine Learning and Consumption
I have been working for a while on the Nepali Language processing and machine learning. Although some of the code is available in Github, majority of the code is in my private bitbucket. This diagram shows an overview of how the system that I have written does a crawling, data clensing, validation and then trains… Continue reading Architecture: Nepali Language Crawling, Machine Learning and Consumption
List of Nepali Stop Words for Natural Languauge Processing
This is probably the most comprehensive list of Nepali stop words found on the internet. I prepared this list from analyzing over 1.2 million Nepali Sentences that produced over 800,000 Nepali words (root and compound). ******************************************************************* @author – Kushal Paudyal Downloaded from: https://github.com/kushalzone/NepaliStopWords/ Prepared for: nlp.icodejava.com Last Modified On: 04/03/2018 *******************************************************************
Welcome to Nepali Machine Learning, Deep Learning, Artificial Intelligence.
Welcome to the Nepali Natural Language Processing, deep learning and artificial intelligence website. I have a lot of research going on these topics behind the scene and will be publishing some of the amazing results in this website. Hopefully you will enjoy the content, get inspired or make use of it. Most of the work… Continue reading Welcome to Nepali Machine Learning, Deep Learning, Artificial Intelligence.