Here is an important new step in Python- the established statistical programming language (used to be really pushed by SPSS in pre-IBM days and the rPy package integrates R and Python).
Well the news ( http://www.kdnuggets.com/2010/10/eap-evolutionary-algorithms-in-python.html ) is the release of Distributed Evolutionary Algorithms in Python. If your understanding of modeling means running regression and iterating it- you may need to read some more. If you have felt frustrated at lack of parallelization in statistical software as well as your own hardware constraints- well go DEAP (and for corporate types the licensing is
DEAP is intended to be an easy to use distributed evolutionary algorithm library in the Python language. Its two main components are modular and can be used separately. The first module is a Distributed Task Manager (DTM), which is intended to run on cluster of computers. The second part is the Evolutionary Algorithms in Python (EAP) framework.
DTM is a distributed task manager that is able to spread workload over a buch of computers using a TCP or a MPI connection.
DTM include the following features:
- Easy to use parallelization paradigms
- Offers a similar interface to the Python’s multiprocessing module
- Basic load balancing algorithm
- Works with both mpi4py and pyMPI
- Support for TCP communication manager
EAP includes the following features:
- Genetic algorithm using any imaginable representation
- List, Array, Set, Dictionary, Tree, …
- Genetic programing using prefix trees
- Loosely typed, Strongly typed
- Automatically defined functions (new v0.6)
- Evolution strategies (including CMA-ES)
- Multi-objective optimisation (NSGA-II, SPEA-II)
- Parallelization of the evaluations (and maybe more) (requires python2.6 and preferably python2.7) (new v0.6)
- Genealogy of an evolution (that is compatible with NetworkX) (new v0.6)
- Hall of Fame of the best individuals that lived in the population (new v0.5)
- Milestones that take snapshot of a system regularly (new v0.5)
See the eap user’s guide for EAP 0.6 documentation.
The most basic features of EAP requires Python2.5 (we simply do not offer support for 2.4). In order to use multiprocessing you will need Python2.6 and to be able to combine the toolbox and the multiprocessing module Python2.7 is needed for its support to pickle partial functions.
Projects using EAP
If you want your project listed here, simply send us a link and a brief description and we’ll be glad to add it.
and from the wordpress.com blog (funny how people like code.google.com but not blogger.google.com anymore) at http://deapdev.wordpress.com/
EAP is part of the DEAP project, that also includes some facilities for the automatic distribution and parallelization of tasks over a cluster of computers. The D part of DEAP, called DTM, is under intense development and currently available as an alpha version. DTM currently provides two and a half ways to distribute workload on a cluster or LAN of workstations, based on MPI and TCP communication managers.
This public release (version 0.6) is more complete and simpler than ever. It includes Genetic Algorithms using any imaginable representation, Genetic Programming with strongly and loosely typed trees in addition to automatically defined functions, Evolution Strategies (including Covariance Matrix Adaptation), multiobjective optimization techniques (NSGA-II and SPEA2), easy parallelization of algorithms and much more like milestones, genealogy, etc.
We are impatient to hear your feedback and comments on that system at .
François-Michel De Rainville
Laboratoire de vision et systèmes numériques
Département de génie électrique et génie informatique
Quebec City (Quebec), Canada
and if you are new to Python -sigh here are some statistical things (read ad-van-cED analytics using Python) by a slideshare from Visual numerics (pre Rogue Wave acquisition)
- Python: 50 modules for all needs – CatsWhoCode.com (catswhocode.com)
- Ubuntu Classroom: Beginners Team Dev Academy: Introduction to Python: Part 4 (ubuntuclassroom.wordpress.com)
- Safely Handling Rich HTML in Python Apps (michael-coates.blogspot.com)
- Python programming: what next? (ask.metafilter.com)