|Last Updated|| ||Ratings|| ||Unique User Downloads|| ||Download Rankings|
|2023-12-03 (3 days ago) ||Not enough user ratings||Total: 398 This week: 6||All time: 6,558 This week: 63|
This class can fill records of MySQL tables with test data.
It takes the SQL dump file of a MySQL database and parses it to extract the list of database tables.
The class executes SQL statements to insert records on the MySQL database tables.
The new record field values can be generated randomly or set to a constant value.
The number of records to insert, the range of characters to use in random data and the character set encoding are configurable parameters.
* Example to set-up and call databasefiller.class.php
* Martin Latter, 14/12/2014
ini_set('memory_limit', '256M'); # for inserting a large number of rows ($aConfiguration['num_rows'])
header('Content-Type: text/html; charset=utf-8');
* Configuration array settings to pass to databasefiller.class.php
# output type toggle
'debug' => false, # set TRUE for verbose screen output and no database insertion, FALSE for database insertion
# number of rows to insert
'num_rows' => 10,
// optimise mysqld variables in my.cnf/my.ini files when inserting a large number of rows (e.g. 50000)
# database details
'host' => 'localhost',
'database' => 'dbfilltest',
'username' => 'USERNAME',
'password' => 'PASSWORD',
# schema file
'schema_file' => 'test.sql',
# database connection encoding
'encoding' => 'utf8', # latin1 / utf8 etc
# random data toggle - set to false for a much faster fixed character fill - but ... no unique indexes permitted
'random_data' => true,
# random character range: ASCII integer values
'low_char' => 33,
'high_char' => 126,
// 'incremental_ints' => true,
// 'populate_primary_key' => true, # experimental
# CLI usage: rows of SQL generated before displaying progress percentage
'row_counter_threshold' => 1000
$oDF = new DatabaseFiller($aConfiguration);
This repo is shoved into retirement. The schema file parsing and single-threaded nature of PHP, along with high memory usage makes this package obsolete.
Populate MySQL database tables with test data by parsing the SQL schema file.
Database table population without using any real or sensitive data:
Schema design and development:
+ Check table field population with specified datatypes, potential data truncation etc.
+ Test connection encoding and character encoding, and data insertion speeds.
Originally, I needed to populate a database containing 14 complex tables. Tools such as Spawner are ideal for populating small tables, but in this case, specifying the datatypes for 300+ fields to initiate Spawner would have been insanity.
Instead, why not parse the SQL schema?
The script expects the database schema to already exist in MySQL (`mysql -u root -p < test.sql`).
All table names and column names in the MySQL schema require back-ticks.
Unique keys must be removed from tables when the configuration array option random_data is set to false.
The majority of MySQL datatypes are supported.
Any foreign keys are disabled on data population.
Random character generation is slow in PHP, and such slowness further depends on field length, number of fields, and the number of rows being generated.
Multiple INSERTs are added in a single query, which is quite fast. The number of INSERTs per second will depend on MySQL configuration settings (the defaults are not optimised), datatype / length inserted, system load, operating system, hardware etc.
Configuration boolean toggles (
false by default):
+ make added integers incremental, enabling simplistic integer foreign keys.
+ populate a primary key field, e.g. a UUID used as a primary key (experimental, supports only some definitions).
Ensure the database already exists in MySQL
e.g. for the test schema:
mysql -u root -p < test.sql
Adjust the array connection details and parameters in the file databasefiller_example.php
Then execute this file with PHP on the command-line:
or run the file through a web server e.g.
SQLParser would have been used in this project had it been available in 2014.
Database Filler is released under the GPL v.3.
||Applications that use this package
No pages of applications that use this class were specified.
If you know an application of this package, send a message to the author to add a link here.