Tag: performance tuning

Denormalised Design: Prime Numbers and SQL

Many may think that prime numbers are for the mathematicians to play with, and bit of an obscure combination to use with SQL. However, they can be very useful for implementing a compressed data solution providing some additional set theory operations difficult to achieve in SQL.

ETL/Express – Bulk Data Loading Tool

If you are an organisation challenged with reducing the costs and improving the performance of your Oracle based ETL solutions, and meeting the demands of DevOps and Cloud Computing, then we may be able to help with our simple, low cost, and highly effective and efficient PL/SQL based ETL tool ETLExpress.

The Challenges

Data warehouses processing very large data volumes with complex multiple concurrent feeds can be immensely difficult to successfully deliver.  As a result, there can be big challenges associated with minimising ETL batch times, eradicating concurrent data loading issues to improve throughput, meeting minimum expected developer skill levels, and justifying the cost of expensive enterprise ETL tools. Additionally, keeping on top of all of this whilst juggling with the demands of meeting DevOps and Cloud Computing requirements only exasperates the challenges.

The Questions

Please take a look at these points to see if ETLEx/press can help you:

  • Are you using Oracle 11g or higher to perform your ETL tasks being into, out of, and within the databases?
  • Do you pay for expensive licences for your enterprise ETL technology?
  • Do you rely on costly specialist resources to administer, develop, and support your ETL solutions?
  • Are your ETL solutions challenged with continuing performance and scalability issues?
  • Find that you have limited scope to improve performance without resorting to bespoke PL/SQL ETL solutions
  • Do your bespoke PL/SQL based ETL solutions lack adequate frameworks, and beyond your in-house skills set to stabilise or improve?
  • Are you under pressure to reduce your IT skills and training costs, with possible outsourcing and/or off-shoring?
  • Are you looking to improve your IT development throughput and time-to-market for your data warehousing solutions?

The Answer

So, answering yes to most of the above will more than likely mean our feature-packed comprehensive ETL application ETL/Express  can help you.

Database Design: Block Size Design

A database designer has a number of factors to consider when determining a tablespace strategy for a database. A big influence on this is the block size of a tablespace, and if not the default size, how they will work with the various caches.

Data Generation: Techniques in SQL

Software applications need to be tested and this may mean being dependent on a lot more data than can be entered through natural means. The quality and authenticity of generated data relies on the sophistication and effort put into the routines. This article describes some techniques to ease the coding.

Database Design: Missing or Bad Statistics

A common cause of poor SQL performance in an application is missing/stale CBO statistics on a table. The typical aim is to have statistics gathered on all tables belonging to an application; however there are situations where statistics are not possible or are inappropriate. This article covers the scenarios where this occurs and proposes methods to ensure that they are applied effectively.

Database Design: Block Contention

A common bottleneck on busy OLTP applications is contention on the buffer cache. If too many sessions attempt to read the same blocks from the buffer cache, then they can queue up waiting for low level latches to be released before they can read the blocks from the cache.