public/ottertune
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
216 Commits 1 Branch 0 Tags
c2d5cbadd63b678ee74e764717fe339f06de5137
Commit Graph
97 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
dvanaken 6bf50b892d Moved dumpdata code from resetwebsite into its own mgmt command, ignore errors from stopcelery kill command, added backdoor method to dump website backend database and logfiles 2020-01-14 07:43:31 -05:00
dvanaken 9f9f2845d6 Fixed formatting 2020-01-13 17:21:56 -05:00
dvanaken 7b962c4065 Updated parser classes to not cache knob/metric catalogs and replaced all queries that filter for numeric metrics with the new MetricType.numeric() method. 2020-01-13 17:21:56 -05:00
dvanaken e1a41928f6 Fixed admin forms for Metric/KnobCatalog models. 2020-01-13 17:21:56 -05:00
dvanaken ee101d818e Added class methods to get numeric/nonnumeric metric types. 2020-01-13 17:21:56 -05:00
dvanaken a4f8e0b37e Cleanup old celery processes in docker/start.sh 2020-01-13 17:21:56 -05:00
dvanaken bcad0fa017 Added CHOOSE to enumvals for Oracle parameter optimizer_mode 2020-01-13 10:09:31 -05:00
dvanaken 2f79bfdc17 Fixed parser to treat enum values as case-insensitive 2020-01-13 10:09:31 -05:00
dvanaken 2adab245c0 added create_knob_settings.py script to pylint exclude list 2020-01-09 03:23:06 -05:00
dvanaken 16348d1c7a Updated fixtures, human-readable values values in knob/metric comparison view 2020-01-09 03:23:06 -05:00
dvanaken c33defa29a Updated oracle knob fixtures 2020-01-09 03:23:06 -05:00
dvanaken 4c6ec3f0fd checkpoint 2020-01-09 03:23:06 -05:00
dvanaken 433bb68f2f Added next few Oracle params 2020-01-09 03:23:06 -05:00
dvanaken e1da577ad0 Fixed formatting 2020-01-08 15:29:31 -05:00
dvanaken 9393fb7aca Fixed bugs and improved logging in config recommendation tasks/views 2020-01-08 15:29:31 -05:00
dvanaken 3786714093 Updated handling of next config in the driver 2020-01-08 15:29:31 -05:00
dvanaken 8cec62160f Create/format/save the recommended config for the latest result before the on_success method. 2020-01-08 15:29:31 -05:00
dvanaken 8001b658c9 Added management function similar to 'startcelery' except that it auto-reloads modified website files. 2020-01-07 04:04:06 -05:00
dvanaken 9fced864fe Updated Django settings: removed unused paths, fixed incorrect paths to media/template dirs, increased size of rotating log files from 50KB to 2MB and the number of backup files. 2020-01-03 07:32:28 -05:00
dvanaken 16acc35f54 Fix style 2019-12-21 06:47:48 +01:00
dvanaken 2a7bc6145f Fixed db time target objective 2019-12-16 20:47:24 +01:00
dvanaken fc4cf0e18b added new oracle knobs 2019-12-15 19:20:29 +01:00
dvanaken 1994a09a6e update docker-compose create script 2019-12-11 19:18:35 +01:00
dvanaken 24a8bbb298 add dev packages to install.sh 2019-12-11 19:18:35 +01:00
dvanaken a144069e6b shuffle lhs samples 2019-12-11 19:18:35 +01:00
dvanaken d25d5b4cca Expose rabbitmq host in docker 2019-12-11 19:18:35 +01:00
dvanaken 4b37dec988 Fixed formatting 2019-12-11 00:40:06 +01:00
dvanaken ffc88bfaae Run ddpg++ by default 2019-12-11 00:40:06 +01:00
dvanaken c4e8eb53a1 Fixed docker tag for base image in travis 2019-12-11 00:40:06 +01:00
dvanaken 65f3a7b0d6 Finished adding support for Oracle enums 2019-12-11 00:40:06 +01:00
dvanaken a3cc34ba8e Updated oracle fixtures 2019-12-10 18:01:56 +01:00
dvanaken 42e1a4add3 Make constants editable 2019-12-10 18:01:56 +01:00
dvanaken a7724233d3 fixed formatting 2019-12-09 22:19:47 +01:00
dvanaken b0cddcc289 Added 3 Oracle hidden knobs 2019-12-09 22:19:47 +01:00
dvanaken 02c40f5cea Adjusted background task time 2019-12-05 20:46:02 -05:00
dvanaken 783b94cd4d Speedup travis-ci tests 2019-12-05 20:46:02 -05:00
dvanaken 9e9c9c7510 Fixed bug when collecting session knobs; for LHS sessions, remove all pre-generated configs if the session knobs are modified 2019-12-05 20:46:02 -05:00
dvanaken 7be5b89975 Changes: when we deploy our docker images we now also build/deploy the internal driver image; fixed .dockerignore; moved integration test data into the driver; fixed cast in oracle db_time target objective. 2019-12-04 17:27:05 -05:00
dvanaken c739eb066e Changes: removed docker centos image; updated expected value used in test in analysis/tests/ddpg_test.py to be less strict; run all tests on travis vm and docker containers; push docker images to docker-hub repo if on the master branch; 2019-12-03 18:33:04 -05:00
dvanaken e80639c859 Fixed formatting 2019-11-26 15:25:06 -05:00
dvanaken 9994a22f16 Updated management commands 2019-11-26 15:25:06 -05:00
dvanaken 4ab2fdfd52 Updated knob tunability getter 2019-11-26 15:25:06 -05:00
dvanaken c23308e9f1 Fixed log output 2019-11-26 05:15:44 -05:00
dvanaken b211ad455d Fixed bug caused by stale value of latest result in views.give_result() 2019-11-26 05:15:44 -05:00
dvanaken 5555ead3a3 Fixed small bug in parser. 2019-11-22 15:12:54 -05:00
dvanaken a0c60afc3c Addressed Dongsheng's review comments. 2019-11-18 13:04:14 -05:00
dvanaken 6a58c52762 formatting 2019-11-18 13:04:14 -05:00
dvanaken 9a4bbeead5 ...formatting 2019-11-18 13:04:14 -05:00
dvanaken a008428903 formatting 2019-11-18 13:04:14 -05:00
dvanaken 2a3b075516 fixed formatting 2019-11-18 13:04:14 -05:00
dvanaken 9055516737 Updating Oracle knobs/metrics 2019-11-18 13:04:14 -05:00
dvanaken a99cf72c6c Updated oracle tunable knobs 2019-11-18 13:04:14 -05:00
dvanaken a5cbb50521 fixed formatting 2019-11-18 13:04:14 -05:00
dvanaken cf19380107 Updated the knob/metric output samples for each of the Oracle versions we support since my fix changed all of them. 2019-11-18 13:04:14 -05:00
dvanaken e1b29eaafa Added support for Oracle v12.1c. 2019-11-18 13:04:14 -05:00
dvanaken d874ca6a8b The Oracle collector now prepends the view name to each metric to avoid overwriting metrics from different views with the same names 2019-11-18 13:04:14 -05:00
dvanaken 6283186d76 Driver now works when the database system is local, remote, or on docker 2019-11-18 13:04:14 -05:00
dvanaken 8ee52a64bf Changed the format of the driver config from JSON to a python settings file to make it easier to update / read. 2019-11-18 13:04:14 -05:00
dvanaken 159e26e1c7 Removed old LHS code from driver (the website already supports running LHS) 2019-11-18 13:04:14 -05:00
dvanaken fcec765a7c Fixing new error in TravisCI builds that happens when installing the Pip package: mysqlclient==1.3.12 2019-11-18 12:28:39 -05:00
dvanaken 67a4a70c09 small fix 2019-11-08 05:49:19 -05:00
dvanaken abbc589880 removed invalid field 2019-11-08 05:49:19 -05:00
dvanaken 4171a662f5 Added backdoor functions for creating/editing/deleting users/projects/sessions in the website and driver. 2019-11-08 05:49:19 -05:00
dvanaken b261cf2139 Added migration for LHS 2019-11-06 21:05:33 -05:00
Dana Van Aken 2974cdab2b Update pylintrc 
Added the migrations directory and manage.py to the ignore list
 2019-10-24 18:30:20 -04:00
dvanaken 7d8dcaee47 This shold fix the error from running git reset on an invalid TRAVIS_COMMIT_RANGE from empty commits and rebases 2019-10-24 00:54:38 -04:00
dvanaken cc421ab959 pass required travis var into the docker container 2019-10-24 00:54:38 -04:00
dvanaken 5c855faa3e Testing gitlint 2019-10-24 00:54:38 -04:00
dvanaken 9f3fe29c27 added the compression option to the main settings file 2019-10-23 22:41:55 -04:00
dvanaken 40024b4d3c Added an option to enable compression on MySQL tables (disabled by default) 2019-10-23 22:41:55 -04:00
dvanaken ec896d01f6 Updated MySQL-specific migration that enables compression to be non-atomic 2019-10-23 22:41:55 -04:00
dvanaken 777c42c979 Bumped numpy from 1.13.1 to 1.14.0 to satisfy TF 1.12.2 dependency. Updated grep commands in validator to also be compatible with BSD. 2019-10-22 19:45:39 -04:00
Dana Van Aken dcb3152ec5 Added valid target objectives to the session create/edit form 2019-10-14 19:08:43 -04:00
Dana Van Aken 2b9f199c6f Call makemigrations before running our Django tests 2019-10-14 19:08:43 -04:00
Dana Van Aken 01b4ec3f53 Support adding custom target objectives to the website/db/*/target_objective.py modules 2019-10-14 19:08:43 -04:00
Dana Van Aken f68c23e975 Added outer db module and moved parser code into it 2019-10-14 19:08:43 -04:00
Dana Van Aken 0da1b724cc Added postgresql client package to Dockerfiles and psycopg2-binary to requirements.txt, removed unused matplotlib code/package from analysis/cluster.py and requirements.txt, replaced commands in docker start.sh file with new management commands. 2019-10-08 09:32:25 -04:00
Dana Van Aken e8f28ebef0 Added another function that converts bytes/ms to human-readable values without loss of resolution. 2019-10-08 09:32:25 -04:00
Dana Van Aken 3d70990ff1 The calculation of maxval for session knobs that use memory/storage resources is now set to 80% of the available resource (versus 100%) 2019-10-08 09:32:25 -04:00
Dana Van Aken c568c09c00 Enforce unique Project.name for same user and unique Session.name for same user and project 2019-10-08 09:32:25 -04:00
Dana Van Aken 40c75de3ce Added additional Oracle views to metric collection (v, v). 2019-10-08 09:32:25 -04:00
Dana Van Aken 162dc48c53 Added option to dump debug info in 3 places: (1) the session view, (2) as a command in manage.py, and (3) as a fab command in the driver. 2019-10-08 09:32:25 -04:00
Dana Van Aken e676433ece Changes: 
- fixed bug in validator causing it to validate files in excluded directories and updated the pre-commit hook
 - hardware uniqueness is now based on the cpu, memory, storage, and storage_type fields, fixes #230
 - initial settings of a minval/maxval for a session knob are calculated based on its resource type and the user's hardware
 - squashed migrations
 2019-10-03 21:31:27 -04:00
Dana Van Aken c14a337695 Removed obsolete methods from parser and fields from Session model 2019-10-03 21:31:27 -04:00
Dana Van Aken b3c42a81fb Added django-db-logger for storing log messages in the database, removed random *.sh scripts from website code then extended manage.py with same commands 2019-10-03 21:31:27 -04:00
Dana Van Aken 6b8aeb6043 fixed expected status_codes in tests 2019-10-03 21:31:27 -04:00
Dana Van Aken 390e58b24d added some manage.py extensions 2019-10-03 21:31:27 -04:00
Dana Van Aken e5edd2a7f4 Fixed celery task logging and added filehandler 2019-10-03 21:31:27 -04:00
Dana Van Aken 863d6619ba Fixed incorrect parsing behavior for float-type metrics 2019-10-03 21:31:27 -04:00
Dana Van Aken d1c13de42f Consolidated driver scripts and added status codes to the query_and_get and new_result responses 2019-10-03 21:31:27 -04:00
Dana Van Aken d7d7f9111f Added new DDPG columns to migrations 2019-09-27 18:18:32 -04:00
Dana Van Aken 7aea07f4c1 Parser cleanup 2019-09-04 22:33:36 -04:00
Dana Van Aken aa01f17eae Removed initialization of parser for unsupported DBMS/version (Postgres v9.5) 2019-09-04 22:33:36 -04:00
Dana Van Aken e6a57d4c92 BaseModel __unicode__ method now returns str(pk) if the 'name' attribute does not exist 2019-09-04 22:33:36 -04:00
Dana Van Aken 7c964758e9 Updated admin: better functionality + faster loading for models with many foreign keys 2019-09-04 22:33:36 -04:00
Dana Van Aken e28c979912 Fixed log messages in migration 0002 2019-09-04 22:33:36 -04:00
Dana Van Aken 149942e6b8 Removed unsupported DBMS/version from the DBMSCatalog (Postgres v9.5) 2019-09-04 22:33:36 -04:00