Apache Crunch 0.7.0
Apache Crunch 0.7.0 summary
Apache Crunch 0.7.0 screenshot
Apache Crunch 0.7.0 description
Apache Crunch was developed as an accessible and open source Java library.
Apache Crunch is designed to provide a framework for writing, testing, and running MapReduce pipelines.
The library is based on FlumeJava and can be used to make pipelines that are composed of many user-defined functions simple to write, easy to test, and efficient to run.
What's New in This Release:
Bug:
· Add MRPipelineExecution to expose some MR-specific APIs
· MemPipeline.write() is inconsistent with MemPipeline.read()
· Remove superfluous directory from source distribution
· Jobs with large numbers of directory inputs will fail with odd inputsplit exceptions
· Update cogroup functions to use mapValues functions
· Crunch PipelineResult objects do not capture failures
· Crunch not working with S3
· Crunch should ignore hidden files
· FileTargetImpl cuts off extensions of output files
· Better error handling for incompatible PTypes and Targets
· DoFn initialize method gets called twice where as cleanup gets called only once when join is performed on two PTables.
· Need to Handle InterruptedException in CrunchJobHooks
· PCollectionGetSizeIT test failure with hadoop-2 profile
· Counters don't work on the post-process function in OneToManyJoin
· Improper job dependencies for certain types of long pipelines
· Add numReducers parameter to the SecondarySort APIs
· Make DefaultJoinStrategy.join(PTable, PTable, JoinFn)...
Apache Crunch 0.7.0 keywords
Apache Crunch 0.7.0 for Developers
Apache Crunch 0.7.0 Copyright
- Smart OCR SDK 5.3
- HS FTP Library 1.3.9
- HS GPSDLL Library 1.9
- PDF417 Decoder SDK/Android 2.5
- Wireless Communication Library VCL Developer Edition 6.12.2.0
- MiTeSystem Information Component Suite 11.3.0
- QRCode Decoder SDK/Android 2.0
- PrintableCal API 1.2.0
- Bar Code Generator for .NET/ASP.NET TBarCode 11.1.0
- Aztec Encoder SDK/NET 2.6
masocongty