Dynamic SQL in the wrong hands can have a drastic affect on the performance of your database. This article discusses remedial and preventative techniques to ensure that your dynamic SQL performs.
Tag: performance tuning
Bulk Data Loading: The available approaches
This articles explores the various programmatic methods of moving large amounts of data between Oracle tables and presents the relative pros and cons.
Data Driven Processing: XML Metadata
The traditional relational database approach for implementing data driven processing would typically store metadata in a set of relational tables. Limitations with maintainability, version control, and deployment make this an unattractive approach compared to the latest XML-centric approaches. How can this be done in PL/SQL?
Denormalised Design: Prime Numbers and SQL
Many may think that prime numbers are for the mathematicians to play with, and bit of an obscure combination to use with SQL. However, they can be very useful for implementing a compressed data solution providing some additional set theory operations difficult to achieve in SQL.
ETL/Express – Bulk Data Loading Tool
If you are an organisation challenged with reducing the costs and improving the performance of your Oracle based ETL solutions, and meeting the demands of DevOps and Cloud Computing, then we may be able to help with our simple, low cost, and highly effective and efficient PL/SQL based ETL tool ETLExpress.
The Challenges
Data warehouses processing very large data volumes with complex multiple concurrent feeds can be immensely difficult to successfully deliver. As a result, there can be big challenges associated with minimising ETL batch times, eradicating concurrent data loading issues to improve throughput, meeting minimum expected developer skill levels, and justifying the cost of expensive enterprise ETL tools. Additionally, keeping on top of all of this whilst juggling with the demands of meeting DevOps and Cloud Computing requirements only exasperates the challenges.
The Questions
Please take a look at these points to see if ETLEx/press can help you:
- Are you using Oracle 11g or higher to perform your ETL tasks being into, out of, and within the databases?
- Do you pay for expensive licences for your enterprise ETL technology?
- Do you rely on costly specialist resources to administer, develop, and support your ETL solutions?
- Are your ETL solutions challenged with continuing performance and scalability issues?
- Find that you have limited scope to improve performance without resorting to bespoke PL/SQL ETL solutions
- Do your bespoke PL/SQL based ETL solutions lack adequate frameworks, and beyond your in-house skills set to stabilise or improve?
- Are you under pressure to reduce your IT skills and training costs, with possible outsourcing and/or off-shoring?
- Are you looking to improve your IT development throughput and time-to-market for your data warehousing solutions?
The Answer
So, answering yes to most of the above will more than likely mean our feature-packed comprehensive ETL application ETL/Express can help you.
Database Design: Block Size Design
A database designer has a number of factors to consider when determining a tablespace strategy for a database. A big influence on this is the block size of a tablespace, and if not the default size, how they will work with the various caches.
Data Generation: Techniques in SQL
Software applications need to be tested and this may mean being dependent on a lot more data than can be entered through natural means. The quality and authenticity of generated data relies on the sophistication and effort put into the routines. This article describes some techniques to ease the coding.
Database Design: Missing or Bad Statistics
A common cause of poor SQL performance in an application is missing/stale CBO statistics on a table. The typical aim is to have statistics gathered on all tables belonging to an application; however there are situations where statistics are not possible or are inappropriate. This article covers the scenarios where this occurs and proposes methods to ensure that they are applied effectively.
Recent Comments