public/ottertune
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
384 Commits 1 Branch 0 Tags
master
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
dvanaken c116c7cdad Fixed data sharing 2020-07-31 17:30:31 -04:00
Dana Van Aken e56309dc28 Update requirements.txt 
Increased required numpy version from 1.14.0 to 1.15.4.
 2020-07-31 12:29:10 -04:00
dvanaken cd4e1ead62 Do not check celery status during unit tests 2020-05-15 20:51:19 -04:00
dvanaken 6d854b86ac Updated enumvals for oracle knob use_large_pages 2020-05-14 12:50:34 -04:00
dvanaken e92f55cc12 Fixed names of dba_workload_replay metrics 2020-04-30 03:19:20 -04:00
Dana Van Aken d47b09b0c0 Added env to docker web credentials.py to set the background task interval 2020-04-17 19:11:06 -04:00
Dana Van Aken c9370b76a3 Cleanup 2020-04-17 19:11:06 -04:00
Dana Van Aken ca63f91f55 Fixed bug in background task that happened when all workload data was invalid 2020-04-17 19:11:06 -04:00
dvanaken 9cc119e129 Added flag to alt_create_or_edit_session() that specifies whether to return the ddpg models 2020-04-17 00:59:37 -04:00
dvanaken b43a911bd7 Logging and cleanup 2020-04-14 11:49:02 -04:00
dvanaken 99c80e2e83 Improved/reordered preprocessing of metrics in workload characterization task to further reduce the number of columns and speed up the computation. Tweaked a few admin views to show more recent info first. 2020-04-14 11:49:02 -04:00
dvanaken efa02899b5 When ranking knobs in the background tasks use the target objective(s) by default. Added an option that when enabled also uses the pruned metrics. 2020-04-14 11:49:02 -04:00
dvanaken aeaae7d9f4 When aggregating knobs/metrics order the columns by name to ensure matrices have consistent columnnames in case they're combined in subsequent tasks. 2020-04-14 11:28:38 -04:00
dvanaken ff0efd7482 Fixed lint errors 2020-04-13 17:30:19 -04:00
dvanaken 4e1233ded2 Added a new textfield to the BackupData model to save additional (not required) files uploaded by the user. 2020-04-13 17:30:19 -04:00
dvanaken 593c4acb1d fixed lint errors 2020-04-03 03:56:59 -04:00
dvanaken 6d123d7509 Bug fix: pass single result object to save_execution_time() 2020-04-03 03:56:59 -04:00
dvanaken 94dcc0530d Fixed lint errors 2020-04-03 03:56:59 -04:00
dvanaken 78c2fa283a Return http error if views.give_result() is called and it's not a tuning session and updated .gitignore 2020-04-03 03:56:59 -04:00
dvanaken 72580f65a0 Startcelery mgmt cmd now pipes output to logfile only if 'console' handler is not present in the Django LOGGING settings. Also updated stopcelery warnings to make it clear they are just warnings not errors. 2020-04-03 03:56:59 -04:00
dvanaken 66ad361654 Fixed super verbose celery log messages and updated Django options to also log messages to the console. 2020-04-03 03:56:59 -04:00
dvanaken 423140169f Made the workload editable so it can be edited in the admin view and cleaned up the admin view and template 2020-04-03 01:50:38 -04:00
dvanaken 8eb79c3cc4 Fixed lint errors 2020-03-19 21:52:51 -04:00
dvanaken c423a4d435 Compute all available target objectives and include them in metrics 2020-03-19 21:52:51 -04:00
Dana Van Aken f61021c32f Fixed setting of session knobs to be case-insensitive and added git commit hash to server info 2020-03-05 17:28:33 -05:00
Dana Van Aken f737a0493e Added backdoor method to get webserver info 2020-03-05 17:28:33 -05:00
dvanaken ae5ab0b9e0 Cleanup backdoor methods 2020-03-03 19:57:14 -05:00
dvanaken 07425da6e8 Fixed style 2020-02-20 17:16:04 -05:00
dvanaken ff488cae35 Updated parser unit tests. 2020-02-20 17:16:04 -05:00
dvanaken 944a0ccc8d Speedup parser 2020-02-20 17:16:04 -05:00
dvanaken 8768686d17 Added rule for new migration file to pylintrc 2020-02-20 00:52:46 -05:00
dvanaken 3bd6d03efe Increased length of function field in executiontime model from 32 to 64 2020-02-20 00:52:46 -05:00
dvanaken 42fc5ebe3e Update celery commands 2020-02-08 17:31:29 -05:00
dvanaken 9a5dea806f Added new migration file to change type of Result.taskids field and cleaned up views.py 2020-02-08 17:31:29 -05:00
dvanaken 4d228f5765 Updated task_ids field from CharField to TextField type 2020-02-08 17:31:29 -05:00
dvanaken ec9066e5b2 Updated handling of celery task status in views 2020-02-08 17:31:29 -05:00
dvanaken d9e2806b9e Changes: 
- website.celery: create celery app
- website.admin: do not unregister the djcelery models
- website.settings: added some new celery settings and updated others. Added 'celery.tasks' to our logging config which resolved the missing celery log messages issue
- website.async_tasks: removed redundant abstract task classes. Removed the settings that configured retries since do not handle retries in the tasks
 2020-02-08 17:31:29 -05:00
dvanaken 7339d07a98 Updated celery package version requirements 2020-02-08 17:31:29 -05:00
dvanaken 06948089d2 Added new model to store execution times 2020-01-23 23:38:56 -05:00
Dana Van Aken 0cbc7ba334 travis-ci: trigger a build in the other repository instead of cloning and building it here 2020-01-23 16:15:49 -05:00
Dana Van Aken 6b78b8a131 Added 'set -e' to the top of docker/install.sh so bash exits if there are any errors during package installation. 2020-01-19 08:52:14 -05:00
Dana Van Aken 286046e2df Save the latest git commit ID inside the Docker containers to /app/.git_commit 2020-01-19 08:52:14 -05:00
Dana Van Aken 35160f2fb4 Upgraded Django from version 1.11.23 to 1.11.27 2020-01-19 06:33:25 -05:00
Dana Van Aken 1d8913f408 When converting a value in bytes to human-readable, if the conversion fails then log a warning and return the original value instead of raising an exception. 2020-01-19 02:43:55 -05:00
dvanaken 6bf50b892d Moved dumpdata code from resetwebsite into its own mgmt command, ignore errors from stopcelery kill command, added backdoor method to dump website backend database and logfiles 2020-01-14 07:43:31 -05:00
dvanaken 9f9f2845d6 Fixed formatting 2020-01-13 17:21:56 -05:00
dvanaken 7b962c4065 Updated parser classes to not cache knob/metric catalogs and replaced all queries that filter for numeric metrics with the new MetricType.numeric() method. 2020-01-13 17:21:56 -05:00
dvanaken e1a41928f6 Fixed admin forms for Metric/KnobCatalog models. 2020-01-13 17:21:56 -05:00
dvanaken ee101d818e Added class methods to get numeric/nonnumeric metric types. 2020-01-13 17:21:56 -05:00
dvanaken a4f8e0b37e Cleanup old celery processes in docker/start.sh 2020-01-13 17:21:56 -05:00
dvanaken bcad0fa017 Added CHOOSE to enumvals for Oracle parameter optimizer_mode 2020-01-13 10:09:31 -05:00
dvanaken 2f79bfdc17 Fixed parser to treat enum values as case-insensitive 2020-01-13 10:09:31 -05:00
dvanaken 2adab245c0 added create_knob_settings.py script to pylint exclude list 2020-01-09 03:23:06 -05:00
dvanaken 16348d1c7a Updated fixtures, human-readable values values in knob/metric comparison view 2020-01-09 03:23:06 -05:00
dvanaken c33defa29a Updated oracle knob fixtures 2020-01-09 03:23:06 -05:00
dvanaken 4c6ec3f0fd checkpoint 2020-01-09 03:23:06 -05:00
dvanaken 433bb68f2f Added next few Oracle params 2020-01-09 03:23:06 -05:00
dvanaken e1da577ad0 Fixed formatting 2020-01-08 15:29:31 -05:00
dvanaken 9393fb7aca Fixed bugs and improved logging in config recommendation tasks/views 2020-01-08 15:29:31 -05:00
dvanaken 3786714093 Updated handling of next config in the driver 2020-01-08 15:29:31 -05:00
dvanaken 8cec62160f Create/format/save the recommended config for the latest result before the on_success method. 2020-01-08 15:29:31 -05:00
dvanaken 8001b658c9 Added management function similar to 'startcelery' except that it auto-reloads modified website files. 2020-01-07 04:04:06 -05:00
dvanaken 9fced864fe Updated Django settings: removed unused paths, fixed incorrect paths to media/template dirs, increased size of rotating log files from 50KB to 2MB and the number of backup files. 2020-01-03 07:32:28 -05:00
dvanaken 16acc35f54 Fix style 2019-12-21 06:47:48 +01:00
dvanaken 2a7bc6145f Fixed db time target objective 2019-12-16 20:47:24 +01:00
dvanaken fc4cf0e18b added new oracle knobs 2019-12-15 19:20:29 +01:00
dvanaken 1994a09a6e update docker-compose create script 2019-12-11 19:18:35 +01:00
dvanaken 24a8bbb298 add dev packages to install.sh 2019-12-11 19:18:35 +01:00
dvanaken a144069e6b shuffle lhs samples 2019-12-11 19:18:35 +01:00
dvanaken d25d5b4cca Expose rabbitmq host in docker 2019-12-11 19:18:35 +01:00
dvanaken 4b37dec988 Fixed formatting 2019-12-11 00:40:06 +01:00
dvanaken ffc88bfaae Run ddpg++ by default 2019-12-11 00:40:06 +01:00
dvanaken c4e8eb53a1 Fixed docker tag for base image in travis 2019-12-11 00:40:06 +01:00
dvanaken 65f3a7b0d6 Finished adding support for Oracle enums 2019-12-11 00:40:06 +01:00
dvanaken a3cc34ba8e Updated oracle fixtures 2019-12-10 18:01:56 +01:00
dvanaken 42e1a4add3 Make constants editable 2019-12-10 18:01:56 +01:00
dvanaken a7724233d3 fixed formatting 2019-12-09 22:19:47 +01:00
dvanaken b0cddcc289 Added 3 Oracle hidden knobs 2019-12-09 22:19:47 +01:00
dvanaken 02c40f5cea Adjusted background task time 2019-12-05 20:46:02 -05:00
dvanaken 783b94cd4d Speedup travis-ci tests 2019-12-05 20:46:02 -05:00
dvanaken 9e9c9c7510 Fixed bug when collecting session knobs; for LHS sessions, remove all pre-generated configs if the session knobs are modified 2019-12-05 20:46:02 -05:00
dvanaken 7be5b89975 Changes: when we deploy our docker images we now also build/deploy the internal driver image; fixed .dockerignore; moved integration test data into the driver; fixed cast in oracle db_time target objective. 2019-12-04 17:27:05 -05:00
dvanaken c739eb066e Changes: removed docker centos image; updated expected value used in test in analysis/tests/ddpg_test.py to be less strict; run all tests on travis vm and docker containers; push docker images to docker-hub repo if on the master branch; 2019-12-03 18:33:04 -05:00
dvanaken e80639c859 Fixed formatting 2019-11-26 15:25:06 -05:00
dvanaken 9994a22f16 Updated management commands 2019-11-26 15:25:06 -05:00
dvanaken 4ab2fdfd52 Updated knob tunability getter 2019-11-26 15:25:06 -05:00
dvanaken c23308e9f1 Fixed log output 2019-11-26 05:15:44 -05:00
dvanaken b211ad455d Fixed bug caused by stale value of latest result in views.give_result() 2019-11-26 05:15:44 -05:00
dvanaken 5555ead3a3 Fixed small bug in parser. 2019-11-22 15:12:54 -05:00
dvanaken a0c60afc3c Addressed Dongsheng's review comments. 2019-11-18 13:04:14 -05:00
dvanaken 6a58c52762 formatting 2019-11-18 13:04:14 -05:00
dvanaken 9a4bbeead5 ...formatting 2019-11-18 13:04:14 -05:00
dvanaken a008428903 formatting 2019-11-18 13:04:14 -05:00
dvanaken 2a3b075516 fixed formatting 2019-11-18 13:04:14 -05:00
dvanaken 9055516737 Updating Oracle knobs/metrics 2019-11-18 13:04:14 -05:00
dvanaken a99cf72c6c Updated oracle tunable knobs 2019-11-18 13:04:14 -05:00
dvanaken a5cbb50521 fixed formatting 2019-11-18 13:04:14 -05:00
dvanaken cf19380107 Updated the knob/metric output samples for each of the Oracle versions we support since my fix changed all of them. 2019-11-18 13:04:14 -05:00
dvanaken e1b29eaafa Added support for Oracle v12.1c. 2019-11-18 13:04:14 -05:00
dvanaken d874ca6a8b The Oracle collector now prepends the view name to each metric to avoid overwriting metrics from different views with the same names 2019-11-18 13:04:14 -05:00