Commit Graph

133 Commits

Author SHA1 Message Date
dvanaken 4171a662f5 Added backdoor functions for creating/editing/deleting users/projects/sessions in the website and driver. 2019-11-08 05:49:19 -05:00
dvanaken b261cf2139 Added migration for LHS 2019-11-06 21:05:33 -05:00
yangdsh ee53d0cead remove contextual gpr 2019-11-04 03:15:33 -05:00
yangdsh e86fce59d9 import Dana's new gpr model 2019-11-04 03:15:33 -05:00
bohanjason 8bb3de85e7 update integration tests 2019-11-03 15:10:32 -05:00
bohanjason 576bbb69bf fix style 2019-11-03 15:10:32 -05:00
bohanjason 2fa97149d5 add integration test 2019-11-03 15:10:32 -05:00
yangdsh 9f71d1c8de improve simulator and ddpg 2019-10-28 20:55:06 -04:00
yangdsh 5431154784 add dnn and gpr to simulation 2019-10-24 22:29:49 -04:00
dvanaken 5c855faa3e Testing gitlint 2019-10-24 00:54:38 -04:00
dvanaken 9f3fe29c27 added the compression option to the main settings file 2019-10-23 22:41:55 -04:00
dvanaken 40024b4d3c Added an option to enable compression on MySQL tables (disabled by default) 2019-10-23 22:41:55 -04:00
dvanaken ec896d01f6 Updated MySQL-specific migration that enables compression to be non-atomic 2019-10-23 22:41:55 -04:00
dependabot[bot] abe439a8e1 Bump django from 1.10.1 to 1.11.23 in /server/website
Bumps [django](https://github.com/django/django) from 1.10.1 to 1.11.23.
- [Release notes](https://github.com/django/django/releases)
- [Commits](https://github.com/django/django/compare/1.10.1...1.11.23)

Signed-off-by: dependabot[bot] <support@github.com>
2019-10-23 22:41:55 -04:00
yangdsh 21f4f40b88 simplify ddpg 2019-10-23 19:54:21 -04:00
dependabot[bot] 336221d886 Bump requests from 2.18.4 to 2.20.0 in /server/website
Bumps [requests](https://github.com/requests/requests) from 2.18.4 to 2.20.0.
- [Release notes](https://github.com/requests/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/master/HISTORY.md)
- [Commits](https://github.com/requests/requests/compare/v2.18.4...v2.20.0)

Signed-off-by: dependabot[bot] <support@github.com>
2019-10-22 21:40:52 -04:00
dvanaken 777c42c979 Bumped numpy from 1.13.1 to 1.14.0 to satisfy TF 1.12.2 dependency. Updated grep commands in validator to also be compatible with BSD. 2019-10-22 19:45:39 -04:00
dependabot[bot] 68fedf765d Bump tensorflow from 1.10 to 1.12.2 in /server/website
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 1.10 to 1.12.2.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v1.10.0...v1.12.2)

Signed-off-by: dependabot[bot] <support@github.com>
2019-10-22 19:45:39 -04:00
yangdsh 826137bd3b add simulation to white-list 2019-10-22 19:42:58 -04:00
yangdsh d71c131e5b work around a pylint & astroid bug 2019-10-22 19:42:58 -04:00
yangdsh 794418d29f simulate a DB tuning environment to test DDPG performance 2019-10-22 19:42:58 -04:00
arifiorino b215b156a4 Moved LHS to Server 2019-10-21 17:35:28 -04:00
yangdsh a2234d08cc set default minval of knob according to hardware 2019-10-15 21:01:53 -04:00
yangdsh e4a97d060d add command resetwebsite 2019-10-15 15:01:55 -04:00
yangdsh fb7ee5c6a3 dump and load session knob tunability 2019-10-15 15:01:55 -04:00
yangdsh ab17aafac4 modify ddpg test
change the expectation values in dnn test
2019-10-15 10:41:38 -04:00
Dana Van Aken dcb3152ec5 Added valid target objectives to the session create/edit form 2019-10-14 19:08:43 -04:00
Dana Van Aken 01b4ec3f53 Support adding custom target objectives to the website/db/*/target_objective.py modules 2019-10-14 19:08:43 -04:00
Dana Van Aken f68c23e975 Added outer db module and moved parser code into it 2019-10-14 19:08:43 -04:00
yangdsh a3833d83b1 normalize reward; square reward 2019-10-14 17:52:04 -04:00
yangdsh 090387a176 change the expected value in ddpg test 2019-10-14 17:52:04 -04:00
yangdsh f071a0e62c modify the hyper parameter and reward of ddpg 2019-10-14 17:52:04 -04:00
bohanjason a5f393cdc1 test for dnn 2019-10-09 00:19:56 -04:00
Dana Van Aken 0da1b724cc Added postgresql client package to Dockerfiles and psycopg2-binary to requirements.txt, removed unused matplotlib code/package from analysis/cluster.py and requirements.txt, replaced commands in docker start.sh file with new management commands. 2019-10-08 09:32:25 -04:00
Dana Van Aken e8f28ebef0 Added another function that converts bytes/ms to human-readable values without loss of resolution. 2019-10-08 09:32:25 -04:00
Dana Van Aken 3d70990ff1 The calculation of maxval for session knobs that use memory/storage resources is now set to 80% of the available resource (versus 100%) 2019-10-08 09:32:25 -04:00
Dana Van Aken c568c09c00 Enforce unique Project.name for same user and unique Session.name for same user and project 2019-10-08 09:32:25 -04:00
Dana Van Aken 40c75de3ce Added additional Oracle views to metric collection (v, v). 2019-10-08 09:32:25 -04:00
Dana Van Aken 162dc48c53 Added option to dump debug info in 3 places: (1) the session view, (2) as a command in manage.py, and (3) as a fab command in the driver. 2019-10-08 09:32:25 -04:00
DongshengYang 309d327a44 use assertAlmostEqual instead of assertEqual 2019-10-08 08:58:51 -04:00
DongshengYang f08204b9d6 Add testing for ddpg model 2019-10-08 08:58:51 -04:00
Bohan Zhang 876d975713 improve UI 2019-10-08 08:29:10 -04:00
bohanjason c5702e9159 tweak alignment in UI 2019-10-08 08:29:10 -04:00
bohanjason 924cccc459 update navbar in UI 2019-10-08 08:29:10 -04:00
bohanjason 63b7dd9a77 modify session page UI 2019-10-08 08:29:10 -04:00
Dana Van Aken e676433ece Changes:
- fixed bug in validator causing it to validate files in excluded directories and updated the pre-commit hook
 - hardware uniqueness is now based on the cpu, memory, storage, and storage_type fields, fixes #230
 - initial settings of a minval/maxval for a session knob are calculated based on its resource type and the user's hardware
 - squashed migrations
2019-10-03 21:31:27 -04:00
Dana Van Aken c14a337695 Removed obsolete methods from parser and fields from Session model 2019-10-03 21:31:27 -04:00
Dana Van Aken b3c42a81fb Added django-db-logger for storing log messages in the database, removed random *.sh scripts from website code then extended manage.py with same commands 2019-10-03 21:31:27 -04:00
Dana Van Aken 6b8aeb6043 fixed expected status_codes in tests 2019-10-03 21:31:27 -04:00
Dana Van Aken 390e58b24d added some manage.py extensions 2019-10-03 21:31:27 -04:00
Dana Van Aken e5edd2a7f4 Fixed celery task logging and added filehandler 2019-10-03 21:31:27 -04:00
Dana Van Aken 863d6619ba Fixed incorrect parsing behavior for float-type metrics 2019-10-03 21:31:27 -04:00
Dana Van Aken d1c13de42f Consolidated driver scripts and added status codes to the query_and_get and new_result responses 2019-10-03 21:31:27 -04:00
DongshengYang 8743c0c2b1 support oracle v12 in ottertune server 2019-10-03 18:58:30 -04:00
bohanjason 494b23678e use algorithm tpye 2019-09-30 01:34:30 -04:00
bohanjason e9f503ef3e change to algoroithm tpyes 2019-09-30 01:34:30 -04:00
bohanjason 25d0838376 save dnn model into database 2019-09-30 01:34:30 -04:00
bohanjason c37ef9c072 move dnn parameters to constant file 2019-09-30 01:34:30 -04:00
bohanjason 82a7d859c2 choose algorithm based on option 2019-09-30 01:34:30 -04:00
bohanjason be955cc812 fix typos 2019-09-30 01:34:30 -04:00
bohanjason e1b97bca9b upgrade tensorflow 2019-09-30 01:34:30 -04:00
bohanjason f716ade292 add noise exploration 2019-09-30 01:34:30 -04:00
bohanjason 11cfe5afc1 add deep learning model 2019-09-30 01:34:30 -04:00
Dana Van Aken d7d7f9111f Added new DDPG columns to migrations 2019-09-27 18:18:32 -04:00
Dongsheng Yang 2c619e017f fix python style 2019-09-27 00:36:21 -04:00
Dongsheng Yang 5ad0e8c44e delete unused algorithm 3 2019-09-27 00:36:21 -04:00
Dongsheng Yang a3fcf59f07 save ddpg model in database 2019-09-27 00:36:21 -04:00
arifiorino c8fbaf6e4b Added if statements to run algorithms 2019-09-27 00:36:21 -04:00
arifiorino dcb23c3a0b Added algorithm selection 2019-09-27 00:36:21 -04:00
Dongsheng Yang bf33be0e27 add torch in requirements.txt 2019-09-27 00:36:21 -04:00
Dongsheng Yang c83f2649b6 Add machine learning model ddpg 2019-09-27 00:36:21 -04:00
arifiorino 043d5b81d0 Fixed test cases 2019-09-24 09:35:20 -04:00
arifiorino 405fb2cd04 Style and added model 2019-09-24 09:35:20 -04:00
arifiorino 89313402a6 Made algorithm not editable after session created 2019-09-24 09:35:20 -04:00
arifiorino 5d4d4a05c9 Added if statements to run algorithms 2019-09-24 09:35:20 -04:00
arifiorino cf4c02496e Added algorithm selection 2019-09-24 09:35:20 -04:00
Dana Van Aken 7aea07f4c1 Parser cleanup 2019-09-04 22:33:36 -04:00
Dana Van Aken aa01f17eae Removed initialization of parser for unsupported DBMS/version (Postgres v9.5) 2019-09-04 22:33:36 -04:00
Dana Van Aken e6a57d4c92 BaseModel __unicode__ method now returns str(pk) if the 'name' attribute does not exist 2019-09-04 22:33:36 -04:00
Dana Van Aken 7c964758e9 Updated admin: better functionality + faster loading for models with many foreign keys 2019-09-04 22:33:36 -04:00
Dana Van Aken e28c979912 Fixed log messages in migration 0002 2019-09-04 22:33:36 -04:00
Dana Van Aken 149942e6b8 Removed unsupported DBMS/version from the DBMSCatalog (Postgres v9.5) 2019-09-04 22:33:36 -04:00
Andy Pavlo 3e564ce922 Initial commit with BSL 2019-08-23 11:47:19 -04:00