awesome-advanced-metering-infrastructure
Awesome Advanced Metering Infrastructure 
The advanced metering infrastructure index connects industrial partners and researchers from the utility and data science domains. We work together to understand smart metering data generated by utilities/operators/manufacturer. Literally billions of smart meter devices are installed in households/buildings/cities, but no one knows how to use all the data.
Can we change that together ?
Academic Partners
Logos go here
Industry Partners
Logos go here
Knowledge Sharing
Academic and industry partners share Smart Meter data, techniques, and understanding in order to maximize impact and move adoption forward.
Data Science Education for Advanced Metering Infrastructure Professionals
Partners receive educational content to help their staff learn how to process Smart Meter data from buildings outside of dataset.
The awesome advanced metering infrastructure (AMI) <https://ami-solution.github.io/awesome-advanced-metering-infrastructure/>_ is acurated list of awesome advanced metering infrastructure frameworks, libraries and software it combines knowledge of utility planning and fluid systems engineering in an integrated framework. This
allows to study the effects, trade-offs and synergies of advanced metering infrastructure design options, utilities retrofits and energy saving infrastructure plans.
-
Click
here <http://ami-solution.github.io/en/latest/getting-started.html>__ for installation manual and tutorials -
Click
here <https://github.com/Ami-Solution/awesome-advanced-metering-infrastructure/issues>__ to report an issue
A curated list of awesome advanced metering infrastructure frameworks, libraries and software (by language). Inspired by awesome-php.
If you want to contribute to this list (please do), send me a pull request. Also, a listed repository should be deprecated if:
- Repository’s owner explicitly say that “this library is not maintained”.
- Not committed for long time (6~8 years).
Further resources:
-
For a list of free advanced metering infrastructure books available for download, go here.
-
For a list of (mostly) free advanced metering infrastructure courses available online, go here.
-
For a list of blogs on data science and advanced metering infrastructure, go here.
Table of Contents
Frameworks and Libraries
- APL
- C
- C++
- Common Lisp
- Clojure
- Crystal
- Elixir
- Erlang
- Go
- Haskell
- Java
- Javascript
- Julia
- Lua
- Matlab
- .NET
- Objective C
- OCaml
- Perl
- Perl 6
- PHP
- Python
- Ruby
- Rust
- R
- SAS
- Scala
- Shell
- Swift
- TensorFlow
Tools
APL
General-Purpose Machine Learning
- naive-apl - Naive Bayesian Classifier implementation in APL.
C
C Amis
- ModBus - sdm120c ModBus Mini Smart Meter EASTRON
- M-bus Library - M-bus Library from Raditex Control; Meter-bus library and utility programs
- Lonworks - Lonworks(R)/IP; iLon SOAP to IEEE1888 Gateway
General-Purpose Machine Learning
- Darknet - Darknet is an open source neural network framework written in C and CUDA. It is fast, easy to install, and supports CPU and GPU computation.
- Recommender - A C library for product recommendations/suggestions using collaborative filtering (CF).
- Hybrid Recommender System - A hybrid recommender system based upon scikit-learn algorithms.
- neonrvm - neonrvm is an open source machine learning library based on RVM technique. It’s written in C programming language and comes with Python programming language bindings.
Computer Vision
- CCV - C-based/Cached/Core Computer Vision Library, A Modern Computer Vision Library.
- VLFeat - VLFeat is an open and portable library of computer vision algorithms, which has Matlab toolbox.
Speech Recognition
- HTK -The Hidden Markov Model Toolkit (HTK) is a portable toolkit for building and manipulating hidden Markov models.
C++
C++ Amis
- GridLabD
- Smart-Grid-protocol
- CitizenSensor - A low budget battery powered LoRa node to smart up your city
- IBM-smart-city-gateway - Create a LoRaWAN based Smart City network
- MBus UDP Converter - A converter that connects to a Kamstrup smart power meter MBUS output, reads OBIS data and sends them as UDP
- T3000 Building Automation System - Bacnet Modbus Zigbee building automation front end
Computer Vision
- DLib - DLib has C++ and Python interfaces for face detection and training general object detectors.
- EBLearn - Eblearn is an object-oriented C++ library that implements various machine learning models
- OpenCV - OpenCV has C++, C, Python, Java and MATLAB interfaces and supports Windows, Linux, Android and Mac OS.
- VIGRA - VIGRA is a generic cross-platform C++ computer vision and machine learning library for volumes of arbitrary dimensionality with Python bindings.
General-Purpose Machine Learning
- BanditLib - A simple Multi-armed Bandit library.
- Caffe - A deep learning framework developed with cleanliness, readability, and speed in mind. [DEEP LEARNING]
- CatBoost - General purpose gradient boosting on decision trees library with categorical features support out of the box. It is easy to install, contains fast inference implementation and supports CPU and GPU (even multi-GPU) computation.
- CNTK - The Computational Network Toolkit (CNTK) by Microsoft Research, is a unified deep-learning toolkit that describes neural networks as a series of computational steps via a directed graph.
- CUDA - This is a fast C++/CUDA implementation of convolutional [DEEP LEARNING]
- CXXNET - Yet another deep learning framework with less than 1000 lines core code [DEEP LEARNING]
- DeepDetect - A machine learning API and server written in C++11. It makes state of the art machine learning easy to work with and integrate into existing applications.
- Distributed Machine learning Tool Kit (DMTK) - A distributed machine learning (parameter server) framework by Microsoft. Enables training models on large data sets across multiple machines. Current tools bundled with it include: LightLDA and Distributed (Multisense) Word Embedding.
- DLib - A suite of ML tools designed to be easy to imbed in other applications.
- DSSTNE - A software library created by Amazon for training and deploying deep neural networks using GPUs which emphasizes speed and scale over experimental flexibility.
- DyNet - A dynamic neural network library working well with networks that have dynamic structures that change for every training instance. Written in C++ with bindings in Python.
- encog-cpp
- Fido - A highly-modular C++ machine learning library for embedded electronics and robotics.
- igraph - General purpose graph library.
- Intel(R) DAAL - A high performance software library developed by Intel and optimized for Intel’s architectures. Library provides algorithmic building blocks for all stages of data analytics and allows to process data in batch, online and distributed modes.
- LightGBM - Microsoft’s fast, distributed, high performance gradient boosting (GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
- libfm - A generic approach that allows to mimic most factorization models by feature engineering.
- MLDB - The Machine Learning Database is a database designed for machine learning. Send it commands over a RESTful API to store data, explore it using SQL, then train machine learning models and expose them as APIs.
- mlpack - A scalable C++ machine learning library.
- proNet-core - A general-purpose network embedding framework: pair-wise representations optimization Network Edit.
- PyCUDA - Python interface to CUDA
- ROOT - A modular scientific software framework. It provides all the functionalities needed to deal with big data processing, statistical analysis, visualization and storage.
- shark - A fast, modular, feature-rich open-source C++ machine learning library.
- Shogun - The Shogun Machine Learning Toolbox.
- sofia-ml - Suite of fast incremental algorithms.
- Stan - A probabilistic programming language implementing full Bayesian statistical inference with Hamiltonian Monte Carlo sampling.
- Timbl - A software package/C++ library implementing several memory-based learning algorithms, among which IB1-IG, an implementation of k-nearest neighbor classification, and IGTree, a decision-tree approximation of IB1-IG. Commonly used for NLP.
- Vowpal Wabbit (VW) - A fast out-of-core learning system.
- Warp-CTC - A fast parallel implementation of Connectionist Temporal Classification (CTC), on both CPU and GPU.
- XGBoost - A parallelized optimized general purpose gradient boosting library.
- LKYDeepNN - A header-only C++11 Neural Network library. Low dependency, native traditional chinese document.
- xLearn - A high performance, easy-to-use, and scalable machine learning package, which can be used to solve large-scale machine learning problems. xLearn is especially useful for solving machine learning problems on large-scale sparse data, which is very common in Internet services such as online advertisement and recommender systems.
- Featuretools - A library for automated feature engineering. It excels at transforming transactional and relational datasets into feature matrices for machine learning using reusable feature engineering “primitives”.
Natural Language Processing
- BLLIP Parser - BLLIP Natural Language Parser (also known as the Charniak-Johnson parser).
- colibri-core - C++ library, command line tools, and Python binding for extracting and working with basic linguistic constructions such as n-grams and skipgrams in a quick and memory-efficient way.
- CRF++ - Open source implementation of Conditional Random Fields (CRFs) for segmenting/labeling sequential data & other Natural Language Processing tasks.
- CRFsuite - CRFsuite is an implementation of Conditional Random Fields (CRFs) for labeling sequential data.
- frog - Memory-based NLP suite developed for Dutch: PoS tagger, lemmatiser, dependency parser, NER, shallow parser, morphological analyzer.
- libfolia - C++ library for the FoLiA format
- MeTA - MeTA : ModErn Text Analysis is a C++ Data Sciences Toolkit that facilitates mining big text data.
- MIT Information Extraction Toolkit - C, C++, and Python tools for named entity recognition and relation extraction
- ucto - Unicode-aware regular-expression based tokenizer for various languages. Tool and C++ library. Supports FoLiA format.
Speech Recognition
- Kaldi - Kaldi is a toolkit for speech recognition written in C++ and licensed under the Apache License v2.0. Kaldi is intended for use by speech recognition researchers.
Sequence Analysis
- ToPS - This is an objected-oriented framework that facilitates the integration of probabilistic models for sequences over a user defined alphabet.
Gesture Detection
- grt - The Gesture Recognition Toolkit (GRT) is a cross-platform, open-source, C++ machine learning library designed for real-time gesture recognition.
Common Lisp
General-Purpose Machine Learning
- mgl - Neural networks (boltzmann machines, feed-forward and recurrent nets), Gaussian Processes.
- mgl-gpr - Evolutionary algorithms.
- cl-libsvm - Wrapper for the libsvm support vector machine library.
- cl-online-learning - Online learning algorithms (Perceptron, AROW, SCW, Logistic Regression).
- cl-random-forest - Implementation of Random Forest in Common Lisp.
Clojure
Natural Language Processing
- Clojure-openNLP - Natural Language Processing in Clojure (opennlp).
- Infections-clj - Rails-like inflection library for Clojure and ClojureScript.
General-Purpose Machine Learning
- Touchstone - Clojure A/B testing library.
- Clojush - The Push programming language and the PushGP genetic programming system implemented in Clojure.
- Infer - Inference and machine learning in Clojure.
- Clj-ML - A machine learning library for Clojure built on top of Weka and friends.
- DL4CLJ - Clojure wrapper for Deeplearning4j.
- Encog - Clojure wrapper for Encog (v3) (Machine-Learning framework that specializes in neural-nets).
- Fungp - A genetic programming library for Clojure.
- Statistiker - Basic Machine Learning algorithms in Clojure.
- clortex - General Machine Learning library using Numenta’s Cortical Learning Algorithm.
- comportex - Functionally composable Machine Learning library using Numenta’s Cortical Learning Algorithm.
- cortex - Neural networks, regression and feature learning in Clojure.
- lambda-ml - Simple, concise implementations of machine learning techniques and utilities in Clojure.
Data Analysis / Data Visualization
- Incanter - Incanter is a Clojure-based, R-like platform for statistical computing and graphics.
- PigPen - Map-Reduce for Clojure.
- Envision - Clojure Data Visualisation library, based on Statistiker and D3.
Crystal
General-Purpose Machine Learning
- machine - Simple machine learning algorithm.
- crystal-fann - FANN (Fast Artificial Neural Network) binding.
Elixir
General-Purpose Machine Learning
- Simple Bayes - A Simple Bayes / Naive Bayes implementation in Elixir.
- emel - A simple and functional machine learning library written in Elixir.
Natural Language Processing
- Stemmer - An English (Porter2) stemming implementation in Elixir.
Erlang
General-Purpose Machine Learning
Go
Natural Language Processing
- go-porterstemmer - A native Go clean room implementation of the Porter Stemming algorithm.
- paicehusk - Golang implementation of the Paice/Husk Stemming Algorithm.
- snowball - Snowball Stemmer for Go.
- Textbox - Natural language processing SDK from Machine Box
- go-ngram - In-memory n-gram index with compression.
- word-embedding - Word Embeddings: the full implementation of word2vec, GloVe in Go.
- sentences - Golang implementation of Punkt sentence tokenizer.
General-Purpose Machine Learning
- eaopt - An evolutionary optimization library.
- Go Learn - Machine Learning for Go.
- go-pr - Pattern recognition package in Go lang.
- go-ml - Linear / Logistic regression, Neural Networks, Collaborative Filtering and Gaussian Multivariate Distribution.
- bayesian - Naive Bayesian Classification for Golang.
- go-galib - Genetic Algorithms library written in Go / Golang.
- Cloudforest - Ensembles of decision trees in Go/Golang.
- gobrain - Neural Networks written in Go.
- GoNN - GoNN is an implementation of Neural Network in Go Language, which includes BPNN, RBF, PCN.
- MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
- go-mxnet-predictor - Go binding for MXNet c_predict_api to do inference with pre-trained model.
- neat - Plug-and-play, parallel Go framework for NeuroEvolution of Augmenting Topologies (NEAT).
- go-ml-transpiler - An open source Go transpiler for machine learning models.
Data Analysis / Data Visualization
- go-graph - Graph library for Go/Golang language.
- SVGo - The Go Language library for SVG generation.
- RF - Random forests implementation in Go.
- Glot - Glot is a plotting library for Golang built on top of gnuplot.
Facial Detection and Recognition
- Facebox - Facial detection and recognition SDK with one-shot teaching from Machine Box
Image Classification
- Tagbox - Image classification SDK with one-shot teaching from Machine Box
- Nudebox - Nudity detection from Machine Box
Haskell
General-Purpose Machine Learning
- haskell-ml - Haskell implementations of various ML algorithms.
- HLearn - a suite of libraries for interpreting machine learning models according to their algebraic structure.
- hnn - Haskell Neural Network library.
- hopfield-networks - Hopfield Networks for unsupervised learning in Haskell.
- caffegraph - A DSL for deep neural networks.
- LambdaNet - Configurable Neural Networks in Haskell.
Java
Java Amis
- AMIS-MIddleWare
- Smart Parking Metering - IoT Smart Parking Metering system with IBM Bluemix & PubNub
- smart-meter dashboard and aggregator - project is used as live demo material for “Spring Boot 2.0 Web Applications”. It uses Java 1.8, Maven 3.5 and a bash-like shell
- SmartWaterMeterReading - SmartWaterMeterReading 0.8 is a project that contains a program that reads images of water meter (GWF MTK) and returns the index.
- Open Smart Grid Platform - OSGP / IoT Open source project about building an Open Smart Grid Platform
- SmartCity-IoT-RFID-NFC - SmaCi is an online platform which provides a user friendly way to interact with your city. Here you can report problems to the appropriate authorities by scanning a QR barcode of the faulty city component, or just by using the near field communication features (RFID/NFC) of your smartphone
- Jakarta Smart City API - API for data like smartcity.jakarta.go.id
- Master Slave Modbus on Maven - High-performance, non-blocking, zero-buffer-copying Modbus for Java
Natural Language Processing
- Cortical.io - Retina: an API performing complex NLP operations (disambiguation, classification, streaming text filtering, etc…) as quickly and intuitively as the brain.
- IRIS - Cortical.io’s FREE NLP, Retina API Analysis Tool (written in JavaFX!) - See the Tutorial Video.
- CoreNLP - Stanford CoreNLP provides a set of natural language analysis tools which can take raw English language text input and give the base forms of words.
- Stanford Parser - A natural language parser is a program that works out the grammatical structure of sentences.
- Stanford POS Tagger - A Part-Of-Speech Tagger (POS Tagger).
- Stanford Name Entity Recognizer - Stanford NER is a Java implementation of a Named Entity Recognizer.
- Stanford Word Segmenter - Tokenization of raw text is a standard pre-processing step for many NLP tasks.
- Tregex, Tsurgeon and Semgrex - Tregex is a utility for matching patterns in trees, based on tree relationships and regular expression matches on nodes (the name is short for “tree regular expressions”).
- Stanford Phrasal: A Phrase-Based Translation System
- Stanford English Tokenizer - Stanford Phrasal is a state-of-the-art statistical phrase-based machine translation system, written in Java.
- Stanford Tokens Regex - A tokenizer divides text into a sequence of tokens, which roughly correspond to “words”.
- Stanford Temporal Tagger - SUTime is a library for recognizing and normalizing time expressions.
- Stanford SPIED - Learning entities from unlabeled text starting with seed sets using patterns in an iterative fashion.
- Stanford Topic Modeling Toolbox - Topic modeling tools to social scientists and others who wish to perform analysis on datasets.
- Twitter Text Java - A Java implementation of Twitter’s text processing library.
- MALLET - A Java-based package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text.
- OpenNLP - a machine learning based toolkit for the processing of natural language text.
- LingPipe - A tool kit for processing text using computational linguistics.
- ClearTK - ClearTK provides a framework for developing statistical natural language processing (NLP) components in Java and is built on top of Apache UIMA.
- Apache cTAKES - Apache clinical Text Analysis and Knowledge Extraction System (cTAKES) is an open-source natural language processing system for information extraction from electronic medical record clinical free-text.
- ClearNLP - The ClearNLP project provides software and resources for natural language processing. The project started at the Center for Computational Language and EducAtion Research, and is currently developed by the Center for Language and Information Research at Emory University. This project is under the Apache 2 license.
- CogcompNLP - This project collects a number of core libraries for Natural Language Processing (NLP) developed in the University of Illinois’ Cognitive Computation Group, for example
illinois-core-utilitieswhich provides a set of NLP-friendly data structures and a number of NLP-related utilities that support writing NLP applications, running experiments, etc,illinois-edisona library for feature extraction from illinois-core-utilities data structures and many other packages.
General-Purpose Machine Learning
- aerosolve - A machine learning library by Airbnb designed from the ground up to be human friendly.
- AMIDST Toolbox - A Java Toolbox for Scalable Probabilistic Machine Learning.
- Datumbox - Machine Learning framework for rapid development of Machine Learning and Statistical applications.
- ELKI - Java toolkit for data mining. (unsupervised: clustering, outlier detection etc.)
- Encog - An advanced neural network and machine learning framework. Encog contains classes to create a wide variety of networks, as well as support classes to normalize and process data for these neural networks. Encog trains using multithreaded resilient propagation. Encog can also make use of a GPU to further speed processing time. A GUI based workbench is also provided to help model and train neural networks.
- FlinkML in Apache Flink - Distributed machine learning library in Flink.
- H2O - ML engine that supports distributed learning on Hadoop, Spark or your laptop via APIs in R, Python, Scala, REST/JSON.
- htm.java - General Machine Learning library using Numenta’s Cortical Learning Algorithm.
- java-deeplearning - Distributed Deep Learning Platform for Java, Clojure, Scala.
- liblinear-java - Java version of liblinear.
- Mahout - Distributed machine learning.
- Meka - An open source implementation of methods for multi-label classification and evaluation (extension to Weka).
- MLlib in Apache Spark - Distributed machine learning library in Spark
- Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.
- Neuroph - Neuroph is lightweight Java neural network framework
- ORYX - Lambda Architecture Framework using Apache Spark and Apache Kafka with a specialization for real-time large-scale machine learning.
- Samoa SAMOA is a framework that includes distributed machine learning for data streams with an interface to plug-in different stream processing platforms.
- RankLib - RankLib is a library of learning to rank algorithms.
- rapaio - statistics, data mining and machine learning toolbox in Java.
- RapidMiner - RapidMiner integration into Java code.
- Stanford Classifier - A classifier is a machine learning tool that will take data items and place them into one of k classes.
- SmileMiner - Statistical Machine Intelligence & Learning Engine.
- SystemML - flexible, scalable machine learning (ML) language.
- WalnutiQ - object oriented model of the human brain.
- Weka - Weka is a collection of machine learning algorithms for data mining tasks.
- LBJava - Learning Based Java is a modeling language for the rapid development of software systems, offers a convenient, declarative syntax for classifier and constraint definition directly in terms of the objects in the programmer’s application.
Speech Recognition
- CMU Sphinx - Open Source Toolkit For Speech Recognition purely based on Java speech recognition library.
Data Analysis / Data Visualization
- Flink - Open source platform for distributed stream and batch data processing.
- Hadoop - Hadoop/HDFS.
- Onyx - Distributed, masterless, high performance, fault tolerant data processing. Written entirely in Clojure.
- Spark - Spark is a fast and general engine for large-scale data processing.
- Storm - Storm is a distributed realtime computation system.
- Impala - Real-time Query for Hadoop.
- DataMelt - Mathematics software for numeric computation, statistics, symbolic calculations, data analysis and data visualization.
- Dr. Michael Thomas Flanagan’s Java Scientific Library
Deep Learning
- Deeplearning4j - Scalable deep learning for industry with parallel GPUs.
Javascript
JavaScript Amis
- node-modbus
- rf-mesh-simulation
- pi-relay-controller
- Energy-Online-DLT
- blockchain-energy-merger-and-acquisition
- DLT-smart-contracts-smart-grid
- smart-meter-data-catalog - Smart Meter related datasets (and code repositories that use these datasets)
Natural Language Processing
- Twitter-text - A JavaScript implementation of Twitter’s text processing library.
- natural - General natural language facilities for node.
- Knwl.js - A Natural Language Processor in JS.
- Retext - Extensible system for analyzing and manipulating natural language.
- NLP Compromise - Natural Language processing in the browser.
- nlp.js - An NLP library built in node over Natural, with entity extraction, sentiment analysis, automatic language identify, and so more
Data Analysis / Data Visualization
- D3.js
- High Charts
- NVD3.js
- dc.js
- chartjs
- dimple
- amCharts
- D3xter - Straight forward plotting built on D3.
- statkit - Statistics kit for JavaScript.
- datakit - A lightweight framework for data analysis in JavaScript
- science.js - Scientific and statistical computing in JavaScript.
- Z3d - Easily make interactive 3d plots built on Three.js
- Sigma.js - JavaScript library dedicated to graph drawing.
- C3.js- customizable library based on D3.js for easy chart drawing.
- Datamaps- Customizable SVG map/geo visualizations using D3.js.
- ZingChart- library written on Vanilla JS for big data visualization.
- cheminfo - Platform for data visualization and analysis, using the visualizer project.
- Learn JS Data
- AnyChart
- FusionCharts
- Nivo - built on top of the awesome d3 and Reactjs libraries
General-Purpose Machine Learning
- Convnet.js - ConvNetJS is a Javascript library for training Deep Learning models[DEEP LEARNING]
- Clusterfck - Agglomerative hierarchical clustering implemented in Javascript for Node.js and the browser.
- Clustering.js - Clustering algorithms implemented in Javascript for Node.js and the browser.
- Decision Trees - NodeJS Implementation of Decision Tree using ID3 Algorithm.
- DN2A - Digital Neural Networks Architecture.
- figue - K-means, fuzzy c-means and agglomerative clustering.
- Gaussian Mixture Model - Unsupervised machine learning with multivariate Gaussian mixture model.
- kalman - Kalman filter for Javascript.
- shaman - Node.js library with support for both simple and multiple linear regression.
- ml.js - Machine learning and numerical analysis tools for Node.js and the Browser!
- ml5 - Friendly machine learning for the web!
- Pavlov.js - Reinforcement learning using Markov Decision Processes.
- MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
- TensorFlow.js - A WebGL accelerated, browser based JavaScript library for training and deploying ML models.
- JSMLT - Machine learning toolkit with classification and clustering for Node.js; supports visualization (see visualml.io).
- xgboost-node - Run XGBoost model and make predictions in Node.js.
Misc
- node-modbus - Node Modbus
Demos and Scripts
- The Bot - Example of how the neural network learns to predict the angle between two points created with Synaptic.
- Half Beer - Beer glass classifier created with Synaptic.
Julia
General-Purpose Machine Learning
- MachineLearning - Julia Machine Learning library.
- MLBase - A set of functions to support the development of machine learning algorithms.
- PGM - A Julia framework for probabilistic graphical models.
- DA - Julia package for Regularized Discriminant Analysis.
- Regression - Algorithms for regression analysis (e.g. linear regression and logistic regression).
- Local Regression - Local regression, so smooooth!.
- Naive Bayes - Simple Naive Bayes implementation in Julia.
- Mixed Models - A Julia package for fitting (statistical) mixed-effects models.
- Simple MCMC - basic mcmc sampler implemented in Julia.
- Distance - Julia module for Distance evaluation.
- Decision Tree - Decision Tree Classifier and Regressor.
- Neural - A neural network in Julia.
- MCMC - MCMC tools for Julia.
- Mamba - Markov chain Monte Carlo (MCMC) for Bayesian analysis in Julia.
- GLM - Generalized linear models in Julia.
- Gaussian Processes - Julia package for Gaussian processes.
- Online Learning
- GLMNet - Julia wrapper for fitting Lasso/ElasticNet GLM models using glmnet.
- Clustering - Basic functions for clustering data: k-means, dp-means, etc.
- SVM - SVM’s for Julia.
- Kernel Density - Kernel density estimators for julia.
- Dimensionality Reduction - Methods for dimensionality reduction.
- NMF - A Julia package for non-negative matrix factorization.
- ANN - Julia artificial neural networks.
- Mocha - Deep Learning framework for Julia inspired by Caffe.
- XGBoost - eXtreme Gradient Boosting Package in Julia.
- ManifoldLearning - A Julia package for manifold learning and nonlinear dimensionality reduction.
- MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
- Merlin - Flexible Deep Learning Framework in Julia.
- ROCAnalysis - Receiver Operating Characteristics and functions for evaluation probabilistic binary classifiers.
- GaussianMixtures - Large scale Gaussian Mixture Models.
- ScikitLearn - Julia implementation of the scikit-learn API.
- Knet - Koç University Deep Learning Framework.
Natural Language Processing
- Topic Models - TopicModels for Julia.
- Text Analysis - Julia package for text analysis.
Data Analysis / Data Visualization
- Graph Layout - Graph layout algorithms in pure Julia.
- LightGraphs - Graph modeling and analysis.
- Data Frames Meta - Metaprogramming tools for DataFrames.
- Julia Data - library for working with tabular data in Julia.
- Data Read - Read files from Stata, SAS, and SPSS.
- Hypothesis Tests - Hypothesis tests for Julia.
- Gadfly - Crafty statistical graphics for Julia.
- Stats - Statistical tests for Julia.
- RDataSets - Julia package for loading many of the data sets available in R.
- DataFrames - library for working with tabular data in Julia.
- Distributions - A Julia package for probability distributions and associated functions.
- Data Arrays - Data structures that allow missing values.
- Time Series - Time series toolkit for Julia.
- Sampling - Basic sampling algorithms for Julia.
Misc Stuff / Presentations
- DSP - Digital Signal Processing (filtering, periodograms, spectrograms, window functions).
- JuliaCon Presentations - Presentations for JuliaCon.
- SignalProcessing - Signal Processing tools for Julia.
- Images - An image library for Julia.
Lua
General-Purpose Machine Learning
- Torch7
- cephes - Cephes mathematical functions library, wrapped for Torch. Provides and wraps the 180+ special mathematical functions from the Cephes mathematical library, developed by Stephen L. Moshier. It is used, among many other places, at the heart of SciPy.
- autograd - Autograd automatically differentiates native Torch code. Inspired by the original Python version.
- graph - Graph package for Torch.
- randomkit - Numpy’s randomkit, wrapped for Torch.
- signal - A signal processing toolbox for Torch-7. FFT, DCT, Hilbert, cepstrums, stft.
- nn - Neural Network package for Torch.
- torchnet - framework for torch which provides a set of abstractions aiming at encouraging code re-use as well as encouraging modular programming.
- nngraph - This package provides graphical computation for nn library in Torch7.
- nnx - A completely unstable and experimental package that extends Torch’s builtin nn library.
- rnn - A Recurrent Neural Network library that extends Torch’s nn. RNNs, LSTMs, GRUs, BRNNs, BLSTMs, etc.
- dpnn - Many useful features that aren’t part of the main nn package.
- dp - A deep learning library designed for streamlining research and development using the Torch7 distribution. It emphasizes flexibility through the elegant use of object-oriented design patterns.
- optim - An optimization library for Torch. SGD, Adagrad, Conjugate-Gradient, LBFGS, RProp and more.
- unsup - A package for unsupervised learning in Torch. Provides modules that are compatible with nn (LinearPsd, ConvPsd, AutoEncoder, …), and self-contained algorithms (k-means, PCA).
- manifold - A package to manipulate manifolds.
- svm - Torch-SVM library.
- lbfgs - FFI Wrapper for liblbfgs.
- vowpalwabbit - An old vowpalwabbit interface to torch.
- OpenGM - OpenGM is a C++ library for graphical modeling, and inference. The Lua bindings provide a simple way of describing graphs, from Lua, and then optimizing them with OpenGM.
- spaghetti - Spaghetti (sparse linear) module for torch7 by @MichaelMathieu
- LuaSHKit - A lua wrapper around the Locality sensitive hashing library SHKit
- kernel smoothing - KNN, kernel-weighted average, local linear regression smoothers.
- cutorch - Torch CUDA Implementation.
- cunn - Torch CUDA Neural Network Implementation.
- imgraph - An image/graph library for Torch. This package provides routines to construct graphs on images, segment them, build trees out of them, and convert them back to images.
- videograph - A video/graph library for Torch. This package provides routines to construct graphs on videos, segment them, build trees out of them, and convert them back to videos.
- saliency - code and tools around integral images. A library for finding interest points based on fast integral histograms.
- stitch - allows us to use hugin to stitch images and apply same stitching to a video sequence.
- sfm - A bundle adjustment/structure from motion package.
- fex - A package for feature extraction in Torch. Provides SIFT and dSIFT modules.
- OverFeat - A state-of-the-art generic dense feature extractor.
- wav2letter - a simple and efficient end-to-end Automatic Speech Recognition (ASR) system from Facebook AI Research.
- Numeric Lua
- Lunatic Python
- SciLua
- Lua - Numerical Algorithms
- Lunum
Demos and Scripts
- Core torch7 demos repository.
- linear-regression, logistic-regression
- face detector (training and detection as separate demos)
- mst-based-segmenter
- train-a-digit-classifier
- train-autoencoder
- optical flow demo
- train-on-housenumbers
- train-on-cifar
- tracking with deep nets
- kinect demo
- filter-bank visualization
- saliency-networks
- Training a Convnet for the Galaxy-Zoo Kaggle challenge(CUDA demo)
- Music Tagging - Music Tagging scripts for torch7.
- torch-datasets - Scripts to load several popular datasets including:
- BSR 500
- CIFAR-10
- COIL
- Street View House Numbers
- MNIST
- NORB
- Atari2600 - Scripts to generate a dataset with static frames from the Arcade Learning Environment.
Matlab
Computer Vision
- Contourlets - MATLAB source code that implements the contourlet transform and its utility functions.
- Shearlets - MATLAB code for shearlet transform.
- Curvelets - The Curvelet transform is a higher dimensional generalization of the Wavelet transform designed to represent images at different scales and different angles.
- Bandlets - MATLAB code for bandlet transform.
- mexopencv - Collection and a development kit of MATLAB mex functions for OpenCV library.
Natural Language Processing
- NLP - An NLP library for Matlab.
General-Purpose Machine Learning
- Training a deep autoencoder or a classifier on MNIST digits - Training a deep autoencoder or a classifier on MNIST digits[DEEP LEARNING].
- Convolutional-Recursive Deep Learning for 3D Object Classification - Convolutional-Recursive Deep Learning for 3D Object Classification[DEEP LEARNING].
- t-Distributed Stochastic Neighbor Embedding - t-Distributed Stochastic Neighbor Embedding (t-SNE) is a (prize-winning) technique for dimensionality reduction that is particularly well suited for the visualization of high-dimensional datasets.
- Spider - The spider is intended to be a complete object orientated environment for machine learning in Matlab.
- LibSVM - A Library for Support Vector Machines.
- ThunderSVM - An Open-Source SVM Library on GPUs and CPUs
- LibLinear - A Library for Large Linear Classification.
- Machine Learning Module - Class on machine w/ PDF, lectures, code
- Caffe - A deep learning framework developed with cleanliness, readability, and speed in mind.
- Pattern Recognition Toolbox - A complete object-oriented environment for machine learning in Matlab.
- Pattern Recognition and Machine Learning - This package contains the matlab implementation of the algorithms described in the book Pattern Recognition and Machine Learning by C. Bishop.
- Optunity - A library dedicated to automated hyperparameter optimization with a simple, lightweight API to facilitate drop-in replacement of grid search. Optunity is written in Python but interfaces seamlessly with MATLAB.
- MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
- Machine Learning in MatLab/Octave - examples of popular machine learning algorithms (neural networks, linear/logistic regressions, K-Means, etc.) with code examples and mathematics behind them being explained.
Data Analysis / Data Visualization
- matlab_gbl - MatlabBGL is a Matlab package for working with graphs.
- gamic - Efficient pure-Matlab implementations of graph algorithms to complement MatlabBGL’s mex functions.
.NET
Computer Vision
- OpenCVDotNet - A wrapper for the OpenCV project to be used with .NET applications.
- Emgu CV - Cross platform wrapper of OpenCV which can be compiled in Mono to be run on Windows, Linus, Mac OS X, iOS, and Android.
- AForge.NET - Open source C# framework for developers and researchers in the fields of Computer Vision and Artificial Intelligence. Development has now shifted to GitHub.
- Accord.NET - Together with AForge.NET, this library can provide image processing and computer vision algorithms to Windows, Windows RT and Windows Phone. Some components are also available for Java and Android.
Natural Language Processing
- Stanford.NLP for .NET - A full port of Stanford NLP packages to .NET and also available precompiled as a NuGet package.
General-Purpose Machine Learning
- Accord-Framework -The Accord.NET Framework is a complete framework for building machine learning, computer vision, computer audition, signal processing and statistical applications.
- Accord.MachineLearning - Support Vector Machines, Decision Trees, Naive Bayesian models, K-means, Gaussian Mixture models and general algorithms such as Ransac, Cross-validation and Grid-Search for machine-learning applications. This package is part of the Accord.NET Framework.
- DiffSharp - An automatic differentiation (AD) library providing exact and efficient derivatives (gradients, Hessians, Jacobians, directional derivatives, and matrix-free Hessian- and Jacobian-vector products) for machine learning and optimization applications. Operations can be nested to any level, meaning that you can compute exact higher-order derivatives and differentiate functions that are internally making use of differentiation, for applications such as hyperparameter optimization.
- Encog - An advanced neural network and machine learning framework. Encog contains classes to create a wide variety of networks, as well as support classes to normalize and process data for these neural networks. Encog trains using multithreaded resilient propagation. Encog can also make use of a GPU to further speed processing time. A GUI based workbench is also provided to help model and train neural networks.
- GeneticSharp - Multi-platform genetic algorithm library for .NET Core and .NET Framework. The library has several implementations of GA operators, like: selection, crossover, mutation, reinsertion and termination.
- Infer.NET - Infer.NET is a framework for running Bayesian inference in graphical models. One can use Infer.NET to solve many different kinds of machine learning problems, from standard problems like classification, recommendation or clustering through to customised solutions to domain-specific problems. Infer.NET has been used in a wide variety of domains including information retrieval, bioinformatics, epidemiology, vision, and many others.
- ML.NET - ML.NET is a cross-platform open-source machine learning framework which makes machine learning accessible to .NET developers. ML.NET was originally developed in Microsoft Research and evolved into a significant framework over the last decade and is used across many product groups in Microsoft like Windows, Bing, PowerPoint, Excel and more.
- Neural Network Designer - DBMS management system and designer for neural networks. The designer application is developed using WPF, and is a user interface which allows you to design your neural network, query the network, create and configure chat bots that are capable of asking questions and learning from your feed back. The chat bots can even scrape the internet for information to return in their output as well as to use for learning.
- Vulpes - Deep belief and deep learning implementation written in F# and leverages CUDA GPU execution with Alea.cuBase.
Data Analysis / Data Visualization
- numl - numl is a machine learning library intended to ease the use of using standard modeling techniques for both prediction and clustering.
- Math.NET Numerics - Numerical foundation of the Math.NET project, aiming to provide methods and algorithms for numerical computations in science, engineering and every day use. Supports .Net 4.0, .Net 3.5 and Mono on Windows, Linux and Mac; Silverlight 5, WindowsPhone/SL 8, WindowsPhone 8.1 and Windows 8 with PCL Portable Profiles 47 and 344; Android/iOS with Xamarin.
- Sho - Sho is an interactive environment for data analysis and scientific computing that lets you seamlessly connect scripts (in IronPython) with compiled code (in .NET) to enable fast and flexible prototyping. The environment includes powerful and efficient libraries for linear algebra as well as data visualization that can be used from any .NET language, as well as a feature-rich interactive shell for rapid development.
Objective C
General-Purpose Machine Learning
- YCML - A Machine Learning framework for Objective-C and Swift (OS X / iOS).
- MLPNeuralNet - Fast multilayer perceptron neural network library for iOS and Mac OS X. MLPNeuralNet predicts new examples by trained neural network. It is built on top of the Apple’s Accelerate Framework, using vectorized operations and hardware acceleration if available.
- MAChineLearning - An Objective-C multilayer perceptron library, with full support for training through backpropagation. Implemented using vDSP and vecLib, it’s 20 times faster than its Java equivalent. Includes sample code for use from Swift.
- BPN-NeuralNetwork - It implemented 3 layers neural network ( Input Layer, Hidden Layer and Output Layer ) and it named Back Propagation Neural Network (BPN). This network can be used in products recommendation, user behavior analysis, data mining and data analysis.
- Multi-Perceptron-NeuralNetwork - it implemented multi-perceptrons neural network (ニューラルネットワーク) based on Back Propagation Neural Network (BPN) and designed unlimited-hidden-layers.
- KRHebbian-Algorithm - It is a non-supervisor and self-learning algorithm (adjust the weights) in neural network of Machine Learning.
- KRKmeans-Algorithm - It implemented K-Means the clustering and classification algorithm. It could be used in data mining and image compression.
- KRFuzzyCMeans-Algorithm - It implemented Fuzzy C-Means (FCM) the fuzzy clustering / classification algorithm on Machine Learning. It could be used in data mining and image compression.
OCaml
General-Purpose Machine Learning
- Oml - A general statistics and machine learning library.
- GPR - Efficient Gaussian Process Regression in OCaml.
- Libra-Tk - Algorithms for learning and inference with discrete probabilistic models.
- TensorFlow - OCaml bindings for TensorFlow.
Perl
Data Analysis / Data Visualization
- Perl Data Language, a pluggable architecture for data and image processing, which can be used for machine learning.
General-Purpose Machine Learning
- MXnet for Deep Learning, in Perl, also released in CPAN.
- Paws::MachineLearning, using AWS machine learning platform from Perl.
-
Algorithm::SVMLight, implementation of Support Vector Machines with SVMLight under it.
- Several machine learning and artificial intelligence models are
included in the
AInamespace. For instance, you can find Naïve Bayes.
Perl 6
Data Analysis / Data Visualization
- Perl Data Language, a pluggable architecture for data and image processing, which can be used for machine learning.
General-Purpose Machine Learning
PHP
AMIS
Natural Language Processing
- jieba-php - Chinese Words Segmentation Utilities.
General-Purpose Machine Learning
- PHP-ML - Machine Learning library for PHP. Algorithms, Cross Validation, Neural Network, Preprocessing, Feature Extraction and much more in one library.
- PredictionBuilder - A library for machine learning that builds predictions using a linear regression.
- 19 Questions - A machine learning / bayesian inference assigning attributes to objects.
Python
AMI Solution
- Linky domoticz - Get Linky smart meter data and push it to domoticz see https://easydomoticz.com/forum/viewtopic.php?p=45583#p45583
- Smart-City-Services-Lyon - Smart-City-Services-Lyon
- building-data-genome - building-data-genome
- AMI-Smart-Building - Materials and IPython notebooks for “Smart Building and meter Analysis” by LaGuer.
- security testing of smart meters with termineter - security testing of smart meters; Currently supported are Meters using C1219-2007
- Smart meter Prediction - HydroQuebec Home energy usages prediction based on machine learning and smart meter data
- Smart-Meter-Energy-Usage-Forecast - Forecasting Smart Meter Energy Usage using Distributed Systems and Machine Learning
- Hardware design and software for smart water metering using embedded computers. - Cyberinfrastructure for Intelligent Water Supply (CIWS). Using low cost, commercially available, embedded computers and sensors to log data from existing analog residential water meters as well as commercial water meters with pulsed or current loop outputs (4-20 mA) on USU’s campus.
- City Data Exchange & Analytics Middleware (CDX) for Smart Cities - City Data Exchange & Analytics Middleware (CDX) for Smart Cities
- NIST smart cities architecture - IES-City Framework Collaboration Site. This github project is a collaboration site for the NIST led IES-City Framework project.
- Smart-City-Project - Smart-City-Project by TotallyMelvin
- pymodbus - A full modbus protocol written in python ; Pymodbus is a full Modbus protocol implementation using twisted for its asynchronous communications core. It can also be used without any third party dependencies (aside from pyserial) if a more lightweight project is needed. Furthermore, it should work fine under any python version > 2.7 (including python 3+)
- BAC0 BACnet - BAC0 is a Python 3 (3.4 and over) scripting application that uses BACpypes to process BACnet messages on a IP network. This library brings out simple commands to browse a BACnet network, read properties from BACnet devices or write to them.
- bacpypes BACnet - BACpypes provides a BACnet application layer and network layer written in Python for daemons, scripting, and graphical interfaces. This is the current project, not the one over on SourceForge.
- Open Modeling Framework for smart grid - The Open Modeling Framework for smart grid cost-benefit analysis.
Computer Vision
- Scikit-Image - A collection of algorithms for image processing in Python.
- SimpleCV - An open source computer vision framework that gives access to several high-powered computer vision libraries, such as OpenCV. Written on Python and runs on Mac, Windows, and Ubuntu Linux.
- Vigranumpy - Python bindings for the VIGRA C++ computer vision library.
- OpenFace - Free and open source face recognition with deep neural networks.
- PCV - Open source Python module for computer vision.
- face_recognition - Face recognition library that recognize and manipulate faces from Python or from the command line.
- dockerface - Easy to install and use deep learning Faster R-CNN face detection for images and video in a docker container.
- Detectron - FAIR’s software system that implements state-of-the-art object detection algorithms, including Mask R-CNN. It is written in Python and powered by the Caffe2 deep learning framework.
- albumentations - А fast and framework agnostic image augmentation library that implements a diverse set of augmentation techniques. Supports classification, segmentation, detection out of the box. Was used to win a number of Deep Learning competitions at Kaggle, Topcoder and those that were a part of the CVPR workshops.
- pytessarct-Python-tesseract is an optical character recognition (OCR) tool for python. That is, it will recognize and “read” the text embedded in images.Python-tesseract is a wrapper for Google’s Tesseract-OCR Engine.
- imutils-A library containg Convenience functions to make basic image processing operations such as translation, rotation, resizing, skeletonization, and displaying Matplotlib images easier with OpenCV and Python.
- PyTorchCV - A PyTorch-Based Framework for Deep Learning in Computer Vision.
Natural Language Processing
- NLTK - A leading platform for building Python programs to work with human language data.
- Pattern - A web mining module for the Python programming language. It has tools for natural language processing, machine learning, among others.
- Quepy - A python framework to transform natural language questions to queries in a database query language.
- TextBlob - Providing a consistent API for diving into common natural language processing (NLP) tasks. Stands on the giant shoulders of NLTK and Pattern, and plays nicely with both.
- YAlign - A sentence aligner, a friendly tool for extracting parallel sentences from comparable corpora.
- jieba - Chinese Words Segmentation Utilities.
- SnowNLP - A library for processing Chinese text.
- spammy - A library for email Spam filtering built on top of nltk
- loso - Another Chinese segmentation library.
- genius - A Chinese segment base on Conditional Random Field.
- KoNLPy - A Python package for Korean natural language processing.
- nut - Natural language Understanding Toolkit.
- Rosetta - Text processing tools and wrappers (e.g. Vowpal Wabbit)
- BLLIP Parser - Python bindings for the BLLIP Natural Language Parser (also known as the Charniak-Johnson parser).
- PyNLPl - Python Natural Language Processing Library. General purpose NLP library for Python. Also contains some specific modules for parsing common NLP formats, most notably for FoLiA, but also ARPA language models, Moses phrasetables, GIZA++ alignments.
- python-ucto - Python binding to ucto (a unicode-aware rule-based tokenizer for various languages).
- python-frog - Python binding to Frog, an NLP suite for Dutch. (pos tagging, lemmatisation, dependency parsing, NER)
- python-zpar - Python bindings for ZPar, a statistical part-of-speech-tagger, constiuency parser, and dependency parser for English.
- colibri-core - Python binding to C++ library for extracting and working with with basic linguistic constructions such as n-grams and skipgrams in a quick and memory-efficient way.
- spaCy - Industrial strength NLP with Python and Cython.
- PyStanfordDependencies - Python interface for converting Penn Treebank trees to Stanford Dependencies.
- Distance - Levenshtein and Hamming distance computation.
- Fuzzy Wuzzy - Fuzzy String Matching in Python.
- jellyfish - a python library for doing approximate and phonetic matching of strings.
- editdistance - fast implementation of edit distance.
- textacy - higher-level NLP built on Spacy.
- stanford-corenlp-python - Python wrapper for Stanford CoreNLP
- CLTK - The Classical Language Toolkit.
- rasa_nlu - turn natural language into structured data.
- yase - Transcode sentence (or other sequence) to list of word vector .
- Polyglot - Multilingual text (NLP) processing toolkit.
- DrQA - Reading Wikipedia to answer open-domain questions.
- Dedupe - A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.
- Snips NLU - Natural Language Understanding library for intent classification and entity extraction
- NeuroNER - Named-entity recognition using neural networks providing state-of-the-art-results
General-Purpose Machine Learning
- steppy -> Lightweight, Python library for fast and reproducible machine learning experimentation. Introduces very simple interface that enables clean machine learning pipeline design.
- steppy-toolkit -> Curated collection of the neural networks, transformers and models that make your machine learning work faster and more effective.
- CNTK - Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit. Documentation can be found here.
- auto_ml - Automated machine learning for production and analytics. Lets you focus on the fun parts of ML, while outputting production-ready code, and detailed analytics of your dataset and results. Includes support for NLP, XGBoost, CatBoost, LightGBM, and soon, deep learning.
- machine learning - automated build consisting of a web-interface, and set of programmatic-interface API, for support vector machines. Corresponding dataset(s) are stored into a SQL database, then generated model(s) used for prediction(s), are stored into a NoSQL datastore.
- XGBoost - Python bindings for eXtreme Gradient Boosting (Tree) Library.
- Apache SINGA - An Apache Incubating project for developing an open source machine learning library.
- Bayesian Methods for Hackers - Book/iPython notebooks on Probabilistic Programming in Python.
- Featureforge A set of tools for creating and testing machine learning features, with a scikit-learn compatible API.
- MLlib in Apache Spark - Distributed machine learning library in Spark
- Hydrosphere Mist - a service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.
- scikit-learn - A Python module for machine learning built on top of SciPy.
- metric-learn - A Python module for metric learning.
- SimpleAI Python implementation of many of the artificial intelligence algorithms described on the book “Artificial Intelligence, a Modern Approach”. It focuses on providing an easy to use, well documented and tested library.
- astroML - Machine Learning and Data Mining for Astronomy.
- graphlab-create - A library with various machine learning models (regression, clustering, recommender systems, graph analytics, etc.) implemented on top of a disk-backed DataFrame.
- BigML - A library that contacts external servers.
- pattern - Web mining module for Python.
- NuPIC - Numenta Platform for Intelligent Computing.
- Pylearn2 - A Machine Learning library based on Theano.
- keras - High-level neural networks frontend for TensorFlow, CNTK and Theano.
- Lasagne - Lightweight library to build and train neural networks in Theano.
- hebel - GPU-Accelerated Deep Learning Library in Python.
- Chainer - Flexible neural network framework.
- prophet - Fast and automated time series forecasting framework by Facebook.
- gensim - Topic Modelling for Humans.
- topik - Topic modelling toolkit.
- PyBrain - Another Python Machine Learning Library.
- Brainstorm - Fast, flexible and fun neural networks. This is the successor of PyBrain.
- Surprise - A scikit for building and analyzing recommender systems.
- Crab - A flexible, fast recommender engine.
- python-recsys - A Python library for implementing a Recommender System.
- thinking bayes - Book on Bayesian Analysis.
- Image-to-Image Translation with Conditional Adversarial Networks - Implementation of image to image (pix2pix) translation from the paper by isola et al.[DEEP LEARNING]
- Restricted Boltzmann Machines -Restricted Boltzmann Machines in Python. [DEEP LEARNING]
- Bolt - Bolt Online Learning Toolbox.
- CoverTree - Python implementation of cover trees, near-drop-in replacement for scipy.spatial.kdtree
- nilearn - Machine learning for NeuroImaging in Python.
- neuropredict - Aimed at novice machine learners and non-expert programmers, this package offers easy (no coding needed) and comprehensive machine learning (evaluation and full report of predictive performance WITHOUT requiring you to code) in Python for NeuroImaging and any other type of features. This is aimed at absorbing the much of the ML workflow, unlike other packages like nilearn and pymvpa, which require you to learn their API and code to produce anything useful.
- imbalanced-learn - Python module to perform under sampling and over sampling with various techniques.
- Shogun - The Shogun Machine Learning Toolbox.
- Pyevolve - Genetic algorithm framework.
- Caffe - A deep learning framework developed with cleanliness, readability, and speed in mind.
- breze - Theano based library for deep and recurrent neural networks.
- pyhsmm - library for approximate unsupervised inference in Bayesian Hidden Markov Models (HMMs) and explicit-duration Hidden semi-Markov Models (HSMMs), focusing on the Bayesian Nonparametric extensions, the HDP-HMM and HDP-HSMM, mostly with weak-limit approximations.
- mrjob - A library to let Python program run on Hadoop.
- SKLL - A wrapper around scikit-learn that makes it simpler to conduct experiments.
- neurolab - https://github.com/zueve/neurolab
- Spearmint - Spearmint is a package to perform Bayesian optimization according to the algorithms outlined in the paper: Practical Bayesian Optimization of Machine Learning Algorithms. Jasper Snoek, Hugo Larochelle and Ryan P. Adams. Advances in Neural Information Processing Systems, 2012.
- Pebl - Python Environment for Bayesian Learning.
- Theano - Optimizing GPU-meta-programming code generating array oriented optimizing math compiler in Python.
- TensorFlow - Open source software library for numerical computation using data flow graphs.
- yahmm - Hidden Markov Models for Python, implemented in Cython for speed and efficiency.
- python-timbl - A Python extension module wrapping the full TiMBL C++ programming interface. Timbl is an elaborate k-Nearest Neighbours machine learning toolkit.
- deap - Evolutionary algorithm framework.
- pydeep - Deep Learning In Python.
- mlxtend - A library consisting of useful tools for data science and machine learning tasks.
- neon - Nervana’s high-performance Python-based Deep Learning framework [DEEP LEARNING].
- Optunity - A library dedicated to automated hyperparameter optimization with a simple, lightweight API to facilitate drop-in replacement of grid search.
- Neural Networks and Deep Learning - Code samples for my book “Neural Networks and Deep Learning” [DEEP LEARNING].
- Annoy - Approximate nearest neighbours implementation.
- skflow - Simplified interface for TensorFlow, mimicking Scikit Learn.
- TPOT - Tool that automatically creates and optimizes machine learning pipelines using genetic programming. Consider it your personal data science assistant, automating a tedious part of machine learning.
- pgmpy A python library for working with Probabilistic Graphical Models.
- DIGITS - The Deep Learning GPU Training System (DIGITS) is a web application for training deep learning models.
- Orange Biolab - Open source data visualization and data analysis for novices and experts.
- MXNet - Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, Javascript and more.
- milk - Machine learning toolkit focused on supervised classification.
- TFLearn - Deep learning library featuring a higher-level API for TensorFlow.
- REP - an IPython-based environment for conducting data-driven research in a consistent and reproducible way. REP is not trying to substitute scikit-learn, but extends it and provides better user experience.
- rgf_python - Python bindings for Regularized Greedy Forest (Tree) Library.
- skbayes - Python package for Bayesian Machine Learning with scikit-learn API.
- fuku-ml - Simple machine learning library, including Perceptron, Regression, Support Vector Machine, Decision Tree and more, it’s easy to use and easy to learn for beginners.
- Xcessiv - A web-based application for quick, scalable, and automated hyperparameter tuning and stacked ensembling.
- PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
- ML-From-Scratch - Implementations of Machine Learning models from scratch in Python with a focus on transparency. Aims to showcase the nuts and bolts of ML in an accessible way.
- Edward - A library for probabilistic modeling, inference, and criticism. Built on top of TensorFlow.
- xRBM - A library for Restricted Boltzmann Machine (RBM) and its conditional variants in Tensorflow.
- CatBoost - General purpose gradient boosting on decision trees library with categorical features support out of the box. It is easy to install, well documented and supports CPU and GPU (even multi-GPU) computation.
- stacked_generalization - Implementation of machine learning stacking technic as handy library in Python.
- modAL - A modular active learning framework for Python, built on top of scikit-learn.
- Cogitare: A Modern, Fast, and Modular Deep Learning and Machine Learning framework for Python.
- Parris - Parris, the automated infrastructure setup tool for machine learning algorithms.
- neonrvm - neonrvm is an open source machine learning library based on RVM technique. It’s written in C programming language and comes with Python programming language bindings.
- Turi Create - Machine learning from Apple. Turi Create simplifies the development of custom machine learning models. You don’t have to be a machine learning expert to add recommendations, object detection, image classification, image similarity or activity classification to your app.
- xLearn - A high performance, easy-to-use, and scalable machine learning package, which can be used to solve large-scale machine learning problems. xLearn is especially useful for solving machine learning problems on large-scale sparse data, which is very common in Internet services such as online advertisement and recommender systems.
- mlens - A high performance, memory efficient, maximally parallelized ensemble learning, integrated with scikit-learn.
- Netron - Visualizer for machine learning models.
- Thampi - Machine Learning Prediction System on AWS Lambda
Data Analysis / Data Visualization
- SciPy - A Python-based ecosystem of open-source software for mathematics, science, and engineering.
- NumPy - A fundamental package for scientific computing with Python.
- Numba - Python JIT (just in time) compiler to LLVM aimed at scientific Python by the developers of Cython and NumPy.
- NetworkX - A high-productivity software for complex networks.
- igraph - binding to igraph library - General purpose graph library.
- Pandas - A library providing high-performance, easy-to-use data structures and data analysis tools.
- Open Mining - Business Intelligence (BI) in Python (Pandas web interface)
- PyMC - Markov Chain Monte Carlo sampling toolkit.
- zipline - A Pythonic algorithmic trading library.
- PyDy - Short for Python Dynamics, used to assist with workflow in the modeling of dynamic motion based around NumPy, SciPy, IPython, and matplotlib.
- SymPy - A Python library for symbolic mathematics.
- statsmodels - Statistical modeling and econometrics in Python.
- astropy - A community Python library for Astronomy.
- matplotlib - A Python 2D plotting library.
- bokeh - Interactive Web Plotting for Python.
- plotly - Collaborative web plotting for Python and matplotlib.
- vincent - A Python to Vega translator.
- d3py - A plotting library for Python, based on D3.js.
- PyDexter - Simple plotting for Python. Wrapper for D3xterjs; easily render charts in-browser.
- ggplot - Same API as ggplot2 for R.
- ggfortify - Unified interface to ggplot2 popular R packages.
- Kartograph.py - Rendering beautiful SVG maps in Python.
- pygal - A Python SVG Charts Creator.
- PyQtGraph - A pure-python graphics and GUI library built on PyQt4 / PySide and NumPy.
- pycascading
- Petrel - Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python.
- Blaze - NumPy and Pandas interface to Big Data.
- emcee - The Python ensemble sampling toolkit for affine-invariant MCMC.
- windML - A Python Framework for Wind Energy Analysis and Prediction.
- vispy - GPU-based high-performance interactive OpenGL 2D/3D data visualization library.
- cerebro2 A web-based visualization and debugging platform for NuPIC.
- NuPIC Studio An all-in-one NuPIC Hierarchical Temporal Memory visualization and debugging super-tool!
- SparklingPandas Pandas on PySpark (POPS).
- Seaborn - A python visualization library based on matplotlib.
- bqplot - An API for plotting in Jupyter (IPython).
- pastalog - Simple, realtime visualization of neural network training performance.
- caravel - A data exploration platform designed to be visual, intuitive, and interactive.
- Dora - Tools for exploratory data analysis in Python.
- Ruffus - Computation Pipeline library for python.
- SOMPY - Self Organizing Map written in Python (Uses neural networks for data analysis).
- somoclu Massively parallel self-organizing maps: accelerate training on multicore CPUs, GPUs, and clusters, has python API.
- HDBScan - implementation of the hdbscan algorithm in Python - used for clustering
- visualize_ML - A python package for data exploration and data analysis.
- scikit-plot - A visualization library for quick and easy generation of common plots in data analysis and machine learning.
- Bowtie - A dashboard library for interactive visualizations using flask socketio and react.
- lime - Lime is about explaining what machine learning classifiers (or models) are doing. It is able to explain any black box classifier, with two or more classes.
- PyCM - PyCM is a multi-class confusion matrix library written in Python that supports both input data vectors and direct matrix, and a proper tool for post-classification model evaluation that supports most classes and overall statistics parameters
- Dash - A framework for creating analytical web applications built on top of Plotly.js, React, and Flask
- Lambdo - A workflow engine for solving machine learning problems by combining in one analysis pipeline (i) feature engineering and machine learning (ii) model training and prediction (iii) table population and column evaluation via user-defined (Python) functions.
Misc Scripts / iPython Notebooks / Codebases
- Map/Reduce implementations of common ML algorithms: Jupyter notebooks that cover how to implement from scratch different ML algorithms (ordinary least squares, gradient descent, k-means, alternating least squares), using Python NumPy, and how to then make these implementations scalable using Map/Reduce and Spark.
- BioPy - Biologically-Inspired and Machine Learning Algorithms in Python.
- SVM Explorer - Interactive SVM Explorer, using Dash and scikit-learn
- pattern_classification
- thinking stats 2
- hyperopt
- numpic
- 2012-paper-diginorm
- A gallery of interesting IPython notebooks
- ipython-notebooks
- data-science-ipython-notebooks - Continually updated Data Science Python Notebooks: Spark, Hadoop MapReduce, HDFS, AWS, Kaggle, scikit-learn, matplotlib, pandas, NumPy, SciPy, and various command lines.
- pandas cookbook - Recipes for using Python’s pandas library.
- Introduction to machine learning with scikit-learn - IPython notebooks from Data School’s video tutorials on scikit-learn.
- Practical XGBoost in Python - comprehensive online course about using XGBoost in Python.
- Introduction to Machine Learning with Python - Notebooks and code for the book “Introduction to Machine Learning with Python”
- Pydata book - Materials and IPython notebooks for “Python for Data Analysis” by Wes McKinney, published by O’Reilly Media.
Neural Networks
- NeuralTalk - NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.
- Neuron - Neuron is simple class for time series predictions. It’s utilize LNU (Linear Neural Unit), QNU (Quadratic Neural Unit), RBF (Radial Basis Function), MLP (Multi Layer Perceptron), MLP-ELM (Multi Layer Perceptron - Extreme Learning Machine) neural networks learned with Gradient descent or LeLevenberg–Marquardt algorithm.
- Data Driven Code - Very simple implementation of neural networks for dummies in python without using any libraries, with detailed comments.
Kaggle Competition Source Code
- hourly power consumption forecasting assumptions -> source code and dataset for Hourly Energy Consumption in megawatts. hourly power consumption data comes from PJM’s website and are in megawatts (MW)
Reinforcement Learning
- DeepMind Lab - DeepMind Lab is a 3D learning environment based on id Software’s Quake III Arena via ioquake3 and other open source software. Its primary purpose is to act as a testbed for research in artificial intelligence, especially deep reinforcement learning.
- Gym - OpenAI Gym is a toolkit for developing and comparing reinforcement learning algorithms.
- Serpent.AI - Serpent.AI is a game agent framework that allows you to turn any video game you own into a sandbox to develop AI and machine learning experiments. For both researchers and hobbyists.
- Universe - Universe is a software platform for measuring and training an AI’s general intelligence across the world’s supply of games, websites and other applications.
R
AMIS
- Electricity and Gas Smart Meters Time Series Analytics Irish Commission for energy regulations Customer Behaviour Trial - Commission Energy Regulation Smart Meter Project. Electricity and Gas Smart meter Customer Behaviour Trial: During 2009 and 2010, with over 5,000 Irish homes and businesses. http://www.ucd.ie/issda/data/commissionforenergyregulationcer/#
Ruby
Natural Language Processing
- Awesome NLP with Ruby - Curated link list for practical natural language processing in Ruby.
- Treat - Text REtrieval and Annotation Toolkit, definitely the most comprehensive toolkit I’ve encountered so far for Ruby.
- Ruby Linguistics - Linguistics is a framework for building linguistic utilities for Ruby objects in any language. It includes a generic language-independent front end, a module for mapping language codes into language names, and a module which contains various English-language utilities.
- Stemmer - Expose libstemmer_c to Ruby.
- Ruby Wordnet - This library is a Ruby interface to WordNet.
- Raspel - raspell is an interface binding for ruby.
- UEA Stemmer - Ruby port of UEALite Stemmer - a conservative stemmer for search and indexing.
- Twitter-text-rb - A library that does auto linking and extraction of usernames, lists and hashtags in tweets.
General-Purpose Machine Learning
- Awesome Machine Learning with Ruby - Curated list of ML related resources for Ruby.
- Ruby Machine Learning - Some Machine Learning algorithms, implemented in Ruby.
- Machine Learning Ruby
- jRuby Mahout - JRuby Mahout is a gem that unleashes the power of Apache Mahout in the world of JRuby.
- CardMagic-Classifier - A general classifier module to allow Bayesian and other types of classifications.
- rb-libsvm - Ruby language bindings for LIBSVM which is a Library for Support Vector Machines.
- Random Forester - Creates Random Forest classifiers from PMML files.
Data Analysis / Data Visualization
- rsruby - Ruby - R bridge.
- data-visualization-ruby - Source code and supporting content for my Ruby Manor presentation on Data Visualisation with Ruby.
- ruby-plot - gnuplot wrapper for Ruby, especially for plotting ROC curves into SVG files.
- plot-rb - A plotting library in Ruby built on top of Vega and D3.
- scruffy - A beautiful graphing toolkit for Ruby.
Misc
- Big Data For Chimps
- Listof - Community based data collection, packed in gem. Get list of pretty much anything (stop words, countries, non words) in txt, json or hash. Demo/Search for a list
Scala
AMIS
- Smart-Meter Middleware - Smart Meter Middleware Big Data Application in Scala, Shell, Python.
Shell
AMIS
- Raspberry Pi tracker for Neptune R900 smart water meters - Raspberry Pi tracker for Neptune R900 smart water meters Shell and Docker. It works with RTLAMR and RESIN.IO.
Tools
Jupyter
- Notebooks - A starter kit for Jupyter notebooks and machine learning. Companion docker images consist of all combinations of python versions, machine learning frameworks (Keras, PyTorch and Tensorflow) and CPU/CUDA versions.
- DVC - Data Science Version Control is an open-source version control system for machine learning projects with pipelines support. It makes ML projects reproducible and shareable.
- SmartThingsPublic - Groovy IDE allows you to integrate devices directly with the SmartThings hub using ZigBee, Z-Wave, or LAN/HTTP protocols.
- Jupyter Notebook Electrical Load Measurements Dataset - Visualizations of REFIT Electrical Load Measurements Dataset
- Jupyter Notebook OSSDC-VisionBasedACC - Open Source Self Driving Car Initiative OSSDC-VisionBasedACC
- Jupyter Notebook self-driving-car - Udacity Self Driving Car (SDC) Challenges
- Jupyter Notebook London smart-meter - London smart-meter dataset
Credits
Cite us:
| For V0.0.1 (stable): | V0.0.1 |
.. |V0.0.1| image:: https://zenodo.org/badge/DOI/12.1234/zenodo.1234567.svg :target: https://doi.org/12.1234/zenodo.1234567