mapreduce

ZDNet Resources

• sort by:
• Relevance
• Date
• Popularity

MapScale: A Cloud Environment for Scientific Computing

Parallel programming languages have sought out many different means by which many numbers of cores can be utilized for a common goal. Programming languages such as MPI provide a low-level, message passing system, while others such as UPC provide a high-level, shared memory model. Both of these languages and many...

Tags: Environment, Programming Language, Computing, Programming, University Of California, MapReduce, Programming Languages, Development Tools, Software Development, Software/Web Development

White papers 2009-06-12

Amazon launches Hadoop data crunching service

Amazon launches Hadoop data crunching serviceMaking MapReduce MainstreamHadoop is great for teams of developers to crunch data. However, the "tipping point" in bringing the value of MapReduce to companies is by providing enterprise-class database features such as security, tight SQL integration, and more. Aster Data offers nCluster on the Amazon...

Tags: Databases, Storage, Apache Hadoop, Amazon.com Inc., MapReduce, database

Discussion threads 2009-04-02

A technical look at how parallel processing brings vast new capabilities to large-scale BI and data analysis

The core problem we've solved is the ability for our engine to redistribute the data and the computation on the fly, as these queries and analysis are being performed. ... The combination of the software-switch interconnect, which Greenplum built into the Greenplum product, and the underlying use of commodity parallel...

Tags: Business Intelligence, Data Analysis, Data, Parallel Processing, SQL, Greenplum, MapReduce, BriefingsDirect, Programming Languages, Databases, Software Development, Software/Web Development, Enterprise Software, Software, Data Management, Dana Gardner

Blog posts 2009-01-05

Greenplum pushes envelope with MapReduce and parallelism enhancements to its extreme-scale data offering

Greenplum pushes envelope with MapReduce and parallelism enhancements to its extreme-scale data offeringMapReduce overviewFor those who are interested in MapReduce in relation to a RDBMS I have an overview here http://blog.tonybain.com/tony_bain/2008/09/what-is-mapreduce.html

Tags: MapReduce, parallelism enhancement

Discussion threads 2008-09-29

Greenplum pushes envelope with MapReduce and parallelism enhancements to its extreme-scale data offering

It seems that data infrastructure vendors are rushing to the realization that older database architectures have hit a wall in terms of scale and performance. The general solution favors exploiting parallelism to the hilt and aligning database and logic functions in close proximity, while also exploiting MapReduce approaches to provide...

Tags: Data Warehouse, Hewlett-Packard Co., Oracle Corp., Performance, Analytics, Greenplum, MapReduce, Database 3.2, Storage, Databases, Financial Planning, Performance Management, Hardware, Enterprise Software, Software, Data Management, Finance, Human Resources, Workforce Management, Dana Gardner

Blog posts 2008-09-29

Databases leverage MapReduce technology to radically juice data scale, performance, analytics

Databases leverage MapReduce technology to radically juice data scale, performance, analyticsAster In-Database MapReduce Available NowDana - great article – thanks for covering this. Many agree this is a game-changing innovation for the database industry. I'd just like to point out: [1] Aster In-Database MapReduce is available now for evaluation...

Tags: Storage, Financial Planning, juice data, database, MapReduce, analytics, performance

Discussion threads 2008-08-27

Databases leverage MapReduce technology to radically juice data scale, performance, analytics

With better data reach and inclusion, come better results. So BI allows leaders can establish the trends early that will determine their future success or failures. In a fast-paced, global, hyper competitive business landscape these insights are the currency of success for the future. The better you do BI, the...

Tags: Performance, Analytics, Data, MapReduce, Curt, Pricing, Business Intelligence, Tools & Techniques, Financial Planning, Databases, Enterprise Software, Marketing, Software, Data Management, Management, Finance, Dana Gardner

Blog posts 2008-08-27

Google's parallel programming model

Two Google Fellows just published a paper in the latest issue of Communications of the ACM about MapReduce, the parallel programming model used to process more than 20 petabytes of data every day on commodity-based clusters. The latest statistics included in the paper are from September 2007. They show that...

Tags: Google Inc., Programming Model, Programming, MapReduce, Development Tools, Software Development, Software/Web Development, Roland Piquepaille

Blog posts 2008-01-14

A Grid Based System for Data Mining Using MapReduce

This paper discusses a Grid data mining system based on the MapReduce paradigm of computing. The MapReduce paradigm emphasizes system automation of fault tolerance and redundancy, while keeping the programming model for the user very simple. MapReduce is built closely on top of a distributed file system that allows efficient...

Tags: University Of Puerto Rico, MapReduce, MapReduce Paradigm, Data Mining, Business Intelligence, Marketing Research, Databases, Enterprise Software, Software, Data Management, Marketing

White papers 2007-07-17

Google's secret of success? Dealing with failure

Google's secret of success? Dealing with failureI wonder what they use for the desktopIs it linux or MS?Smart Idea!Develop and test on what the average person uses. What a concept!Downloadable links for GFS and Mapreduce papersThe USENIX links require a current USENIX account to download the actual paper, but...

Tags: Mainframes, Linux, Desktops, Google Inc., MapReduce, mainframe, PC, Redundancy

Discussion threads 2005-03-03

Additional Resources

Yahoo pays its 'technical debt' with IT overhaul

Yahoo had a lot of "technical debt"---systems that most companies would call legacy infrastructure---and has it just about paid off. Sam Pullara, chief technologist at Yahoo, walked developers through its infrastructure changes over the last three years. The talk could have come from any enterprise that finds...

Tags: Information Technology, Yahoo! Inc., Sam Pullara, HBase, YQL, Cloud Computing, Virtualization, Open Source, Hardware, Larry Dignan

Blog posts 2009-10-09

Aster nCluster In-Database MapReduce: Deriving Deep Insights from Large Datasets

A lack of expressive techniques to transform and analyze massive data volumes in organizations has led to costly workarounds in data warehousing. One of the first to face the challenge of analyzing petabyte scale data, Google pioneered a software framework called MapReduce for high speed processing of large amounts of...

Tags: Analytics, Aster Data, Financial Planning, Productivity, Databases, Finance, Enterprise Software, Software, Data Management

White papers 2009-10-02

Microsoft releases Dryad concurrent-programming code to academics

It's been two years since Microsoft Chairman Bill Gates talked up Dryad, Microsoft's concurrent-programming competitor to Google's MapReduce and Apache Hadoop. But this week, Dryad was back on the radar screen, with Microsoft's release of the Dryad code to academics and researchers. by Mary Jo Foley

Tags: Academics, Radar, Microsoft Corp., Aerospace & Defense, Manufacturing, Mary Jo Foley

Blog posts 2009-07-17

Oracle Office, MySQL, and other dreams

Oracle Office, MySQL, and other dreamsIt also allows Oracle to take baby steps towards the world where databases become a commodity. They will be already are moving up the chain to applications.In the transition, Oracle will have the number one commodity database with the best monetization strategy, and be able...

Tags: OpenOffice, Databases, OPEN SOURCE, Oracle Corp., Oracle Office, MySQL, database

Discussion threads 2009-05-02

Multi-Dimensional Characterization of Temporal Data Mining on Graphics Processors

Through the algorithmic design patterns of data parallelism and task parallelism, the Graphics Processing Unit GPU offers the potential to vastly accelerate discovery and innovation across a multitude of disciplines. For example, the exponential growth in data volume now presents an obstacle for high-throughput data mining in fields such as...

Tags: Virginia Polytechnic Institute, Processor, Characterization, Graphics, GPU, Data Mining, Business Intelligence, Marketing Research, Databases, Enterprise Software, Software, Data Management, Marketing

White papers 2009-05-01

On Availability of Intermediate Data in Cloud Computations

This paper takes a renewed look at the problem of managing intermediate data that is generated during dataflow computations (e.g., MapReduce, Pig, Dryad, etc.) within clouds. It discusses salient features of the intermediate data and outline requirements for a solution. Its experiments show that existing local write remote read solutions,...

Tags: University Of Illinois, Computation

White papers 2009-04-21

Can Google build open source communities

Can Google build open source communitiesMore contributions, as more devices are deliveredAs more companies start delivering Android devices to the market, there is likely to be a significant increase in contributions to Android outside of Google. These contributions would be changes that companies made, in the process of building their...

Tags: open source, Google Inc., open-source community, OPhone, contribution

Discussion threads 2009-04-10

News to know: IBM-Sun; RIM, Web 2.0; CTIA; Facebook; iPhone

Here are today’s notable headlines. You can get News To Know via email alert and RSS daily.  For continuous updates see BNET’s around-the-Web tech coverage. Larry Dignan: IBM-Sun deal nears finish line; Antitrust worries just starting Sam Diaz: RIM delivers solid Q4 on BlackBerry...

Tags: Apple iPhone, Web, Facebook, Research In Motion Ltd., Larry Dignan, Sun Microsystems Inc., Microsoft Corp., Sam Diaz, CTIA, IBM Corp., Web 2.0, Open Source, Internet

Blog posts 2009-04-03

Amazon's BI-on-the-fly using MapReduce-as-a-service brings huge cloud data crunching to the masses

Amazon's BI-on-the-fly using MapReduce-as-a-service brings huge cloud data crunching to the massesExcellent postDana,Spot on! Thanks.David

Tags: MapReduce-as-a-service, BI-on-the-fly, Amazon.com Inc.

Discussion threads 2009-04-02

Amazon's BI-on-the-fly using MapReduce-as-a-service brings huge cloud data crunching to the masses

In essence, the service, Amazon Elastic MapReduce, if it works as advertised, abstracts the complexity and cost of massive parallel and symmetrical programming and processing so non-computer scientists -- you know, business types -- can examine and query huge data sets. by Dana Gardner

Tags: Amazon.com Inc., Development Tools, Software Development, Software/Web Development, Dana Gardner

Blog posts 2009-04-02