mycloud - cluster computing in the small
I spent a little time cleaning up mycloud recently – it’s a Python library that gives you a simple map/mapreduce interface without any setup (just SSH access).
I’ve been using it a lot for little processing tasks – it saves me a lot of time over running things using just my machine, or having to switch over to writing Hadoop code.
Source is on github, and the package is available on PyPi for easy installation:
MyCloud makes parallelizing your existing Python code using local machines easy – all you need is SSH access to a machine and you too can be part of this whole cloud revolution!
I’ve been using it a lot for little processing tasks – it saves me a lot of time over running things using just my machine, or having to switch over to writing Hadoop code.
Source is on github, and the package is available on PyPi for easy installation:
CODE:
pip install [--user] mycloudBegin verbatim README dumpMyCloud makes parallelizing your existing Python code using local machines easy – all you need is SSH access to a machine and you too can be part of this whole cloud revolution!
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/301743/viewspace-749392/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- Small Multiple(最短路)
- Script: Computing Table Size
- C# split big file into small files as, and merge the small files into big oneC#
- 兒童程式語言small basic
- Small Talk - [Toastmater CC1]AST
- DEVICE DRAW VERTEX BUFFER TOO SMALLdev
- Dialogue: New Chapter in the History of ComputingAPT
- cloud computing雲端計算概念Cloud
- Materialized Views in mobile computing environment (187)ZedView
- CSCI-UA.0480-051: Parallel ComputingParallel
- MA2552 Introduction to Computing (DLI)
- ORACLE _small_table_threshold與eventOracle
- Game Development Methodology for Small Development Teams (轉)GAMdev
- damn small linux 安裝方法(轉)Linux
- [ABC132F] Small Products 題解
- Natural Computing: DNA, Quantum Bits, and the Future of Smart MachinesMac
- EMATM0061: Statistical Computing and Empirical
- Android 外掛框架機制之SmallAndroid框架
- redis.cluster/memcached.cluster/wmware esxiRedis
- MySQL ClusterMySql
- Cluster for MySQLMySql
- MySQL NDB Cluster,Galera Cluster和Percona XtraDB Cluster優缺點總結MySql
- 計算複雜性(Computing Complexity) (轉)
- An Overview of High Performance Computing and Responsibly Reckless AlgorithmsViewORMGo
- Redis Cluster原理Redis
- redis cluster 搭建Redis
- Redis Cluster 3.0Redis
- Redis cluster on WindowsRedisWindows
- Linux ClusterLinux
- Cluster簡介
- redis cluster 配置Redis
- oracle簇clusterOracle
- MySQL-ClusterMySql
- cilium Cluster Mesh
- Cloud Computing –PaaS Hands-on 之神奇的OVAB工具Cloud
- COMPUTING MACHINERY AND INTELLIGENCE -- BY A.M.TURING (轉)MacIntel
- Netty原始碼—六、tiny、small記憶體分配Netty原始碼記憶體
- jscalpel A small feature library that makes it easier to manipulate objectsJSObject