Skip to main content

Home/ Coders/ Group items tagged parallelization

Rss Feed Group items tagged

8More

STXXL : Standard Template Library for Extra Large Data Sets - 4 views

  • The key features of STXXL are:
  • Transparent support of parallel disks. The library provides implementations of basic parallel disk algorithms. STXXL is the only external memory algorithm library supporting parallel disks.
  • The library is able to handle problems of very large size (tested to up to dozens of terabytes).
  • ...4 more annotations...
  • Improved utilization of computer resources. STXXL implementations of external memory algorithms and data structures benefit from overlapping of I/O and computation.
  • Small constant factors in I/O volume. A unique library feature called "pipelining" can save more than half the number of I/Os, by streaming data between algorithmic components, instead of temporarily storing them on disk. A development branch supports asynchronous execution of the algorithmic components, enabling high-level task parallelism.
  • Shorter development times due to well known STL-compatible interfaces for external memory algorithms and data structures.
  • For internal computation, parallel algorithms from the MCSTL or the libstdc++ parallel mode are optionally utilized, making the algorithms inherently benefit from multi-core parallelism.
  •  
    « The core of STXXL is an implementation of the C++ standard template library STL for external memory (out-of-core) computations, i. e., STXXL implements containers and algorithms that can process huge volumes of data that only fit on disks. »
1More

Parallel Testing for PHPUnit with ParaTest - 0 views

  •  
    PHPUnit has hinted at parallelism since 2007, but, in the meantime, our tests continue to run slowly. Time is money, right? ParaTest is a tool that sits on top of PHPUnit and allows you to run tests in parallel without the use of extensions. This is an ideal candidate for functional (i.e Selenium) tests and other long-running processes.
2More

Microsoft Axum - Download Details - 0 views

  • Installer: Axum is an incubation project from Microsoft’s Parallel Computing Platform that aims to validate a safe and productive parallel programming model for the .NET framework. It’s a language that builds upon the architecture of the web and the principles of isolation, actors, and message-passing to increase application safety, responsiveness, scalability and developer productivity. Other advanced concepts we are exploring are data flow networks, asynchronous methods, and type annotations for taming side-effects. Programmer's Guide: Use this simple and easy to follow programmer's guide to learn how to create safe, scalable, and responsive applications with the Axum language. Language Specification: A detailed specification of the Axum language.
  •  
    A .NET language for safe, scalable and productive parallel programming through isolation, actors and message-passing ...
1More

Parallel Performance: Optimize Managed Code For Multi-Core Machines -- MSDN Magazine, O... - 0 views

  •  
    An introduction to the Microsoft Task Parallel Library (for .Net).  The Parallel FX Library is currently (Dec, 2007) in CTP.
6More

Joe Duffy's Weblog - OnBeingStateful - 0 views

  • The biggest question left unanswered in my mind is the role state will play in software of the future.
  • The biggest question left unanswered in my mind is the role state will play in software of the future. That seems like an absurd statement, or a naïve one at the very least.  State is everywhere: The values held in memory. Data locally on disk. Data in-flight that is being sent over a network. Data stored in the cloud, including on a database, remote filesystem, etc. Certainly all of these kinds of state will continue to exist far into the future.  Data is king, and is one major factor that will drive the shift to parallel computing.  The question then is how will concurrent programs interact with this state, read and mutate it, and what isolation and synchronization mechanisms are necessary to do so?
  • Many programs have ample gratuitous dependencies, simply because of the habits we’ve grown accustomed to over 30 odd years of imperative programming.  Our education, mental models, books, best-of-breed algorithms, libraries, and languages all push us in this direction.  We like to scribble intermediary state into shared variables because it’s simple to do so and because it maps to our von Neumann model of how the computer works.
  • ...3 more annotations...
  • We need to get rid of these gratuitous dependencies.  Merely papering over them with a transaction—making them “safe”—doesn’t do anything to improve the natural parallelism that a program contains.  It just ensures it doesn’t crash.  Sure, that’s plenty important, but providing programming models and patterns to eliminate the gratuitous dependencies also achieves the goal of not crashing but with the added benefit of actually improving scalability too.  Transactions have worked so well in enabling automatic parallelism in databases because the basic model itself (without transactions) already implies natural isolation among queries.  Transactions break down and scalability suffers for programs that aren’t architected in this way.  We should learn from the experience of the database community in this regard
  • There will always be hidden mutation of shared state inside lower level system components.  These are often called “benevolent side-effects,” thanks to Hoare, and apply to things like lazy initialization and memorization caches.  These will be done by concurrency ninjas who understand locks.  And their effects will be isolated by convention.
  • Even with all of this support, we’d be left with an ecosystem of libraries like the .NET Framework itself which have been built atop a fundamentally mutable and imperative system.  The path forward here is less clear to me, although having the ability to retain a mutable model within pockets of guaranteed isolation certainly makes me think the libraries are salvageable.  Thankfully, the shift will likely be very gradual, and the pieces that pose substantial problems can be rewritten in place incrementally over time.  But we need the fundamental language and type system support first.
2More

100% Web-Based Working For Web Designers - 22 views

  •  
    Web applications are offering an almost desktop-like functionality parallel to the increase in the connectivity speeds, wider usage of the cloud (easier scalability) & improvements in JavaScript/RIA development. This article describes free web applications that you can use to create your own web-based design/development environment:
  •  
    Required backend developer now drop your cv here https://www.owcareers.com/cv-drop-zone
1More

The Julia Language - 8 views

  •  
    Julia is a high-level, high-performance dynamic programming language for technical computing. It supports distributed parallel execution, numerical accuracy, and an extensive mathematical function library. It uses an LLVM-based JIT compiler to achieve near C performance that far outstrips Python/Matlab/R ...
1More

metabuild - Google Code - 0 views

  •  
    MetaBuild is a modular and extensible MSBuild based build system. It breaks monolithic build scripts into modules ("projects") and leverages the MSBuild 3.5 parallel build feature.
1More

Parallel FX - Joe Duffy's Weblog - 0 views

  •  
    nice update on the .Net Parallel Extensions CTP, with links to tutorials, overviews, and videos.
1More

Microsoft released beta of Windows Vista compatibility Update - 0 views

  •  
    The Platform Update is a set of runtime libraries which bring Vista largely up to par with Windows 7 in terms of the: Windows Ribbon control; Automation Manager Library; DirectX updates for hardware acceleration; DirectCompute for hardware-accelerated parallel computing support; the XPS printing library; the Windows Automation API; and the Windows Portable Devices Platform, which standardizes data transfers across apps and portable devices.
1More

Isolation, Agents, and Message-passing in .NET - Axum Team Blog - 0 views

  •  
    This is the team blog for the Microsoft Research team working on "Axum" (another parallel programming language for .Net).
1More

Deployment pipeline anti-patterns | Continuous Delivery - 6 views

  •  
    "So when he found a bug and it was fixed by a developer, he had to wait ages before he could deploy the build with the fix into his testing environment to check it. This problem results from a combination of two anti-patterns that are common when creating a deployment pipeline: * insufficient parallelization, * and over-constraining your pipeline workflow.
1More

How to Setup Selenium Grid For Parallel Execution In Different Browsers - 0 views

  •  
    The first step of a Selenium Grid setup would be to create a hub. You would have to make sure that your system has Java Runtime Environment (JRE) or better yet Java Development Kit (JDK) installed. Though most people recommend going for the latest JDK, I prefer an earlier tried and tested versions like JDK SE 08 or 09. You can go for the latest one if you wish.
1More

Give Google Advertising - 0 views

  •  
    Give Google Advertising To increase your number of customers with Google Adwords is no longer impossible In the Google Advertising of your choice, or get very little money you can set aside for export, and the city can no longer ensure that your ads run .. you should be ready to add to your old customers with Google Adwords . Because it is always possible to us. Caution! * giving Google ad you get ahead of your competitors in the first place . * New customers you get more comfortable and be aware of your presence. * At least spend with you will ensure the greatest return . * it will increase your turnover and profit increases in parallel.
1More

The Ideal HPC Programming Language - ACM Queue - 2 views

  •  
    What if programming did not mean having to learn a language someone else devised and then wrestling with the limitations of that language, its compilers, and computers to implement your task? What if it meant, in a sense, the opposite? You could write your program in whatever way was most expressive for you, without regard for language rules imposed by someone else. Then it would be somebody else's job to define the programming language that would make sense of what you wrote, write the compilers to digest the program, and build the computers that would efficiently run the task you specified.
1 - 16 of 16
Showing 20 items per page