Commit Graph

267 Commits

Author SHA1 Message Date
dvanaken c423a4d435 Compute all available target objectives and include them in metrics 2020-03-19 21:52:51 -04:00
yangdsh 240be46d58 do not use range_test results for tuning 2020-03-19 17:13:30 -04:00
yangdsh 52f4a5801e fix a few bugs 2020-03-19 17:13:30 -04:00
yangdsh 931541d594 change tests 2020-03-11 12:31:06 -04:00
yangdsh 0baaefeb92 fix bugs when number of tunable knobs changes or are inconsistent 2020-03-11 12:31:06 -04:00
yangdsh 1c4cc0c3ed resolve conflict of migration files 2020-03-10 15:52:13 -04:00
yangdsh af2cab8b03 fix edit_knob test 2020-03-10 15:52:13 -04:00
yangdsh d581703375 fix bug of finding worst result when there is no result 2020-03-10 15:52:13 -04:00
yangdsh e5e42a4ed6 fix bug of finding worst result when there is no valid result 2020-03-10 15:52:13 -04:00
yangdsh 029ad0f633 Refactoring: move preprocessing to a new celery task 2020-03-10 15:52:13 -04:00
yangdsh cebc958666 search for knob ranges 2020-03-10 15:52:13 -04:00
bohanjason 9ee71ea58a add pipeline data in results 2020-03-06 15:12:15 -05:00
bohanjason be9307822e pipeline data view in results 2020-03-06 15:12:15 -05:00
bohanjason 84407eb999 add pipeline data view 2020-03-06 15:12:15 -05:00
Dana Van Aken f61021c32f Fixed setting of session knobs to be case-insensitive and added git commit hash to server info 2020-03-05 17:28:33 -05:00
Dana Van Aken f737a0493e Added backdoor method to get webserver info 2020-03-05 17:28:33 -05:00
dvanaken ae5ab0b9e0 Cleanup backdoor methods 2020-03-03 19:57:14 -05:00
yangdsh b86e39b15f fix bugs in the parser and in copying result 2020-03-02 13:29:05 -05:00
bohanjason 21971e673f fix ddpg metrics 2020-02-26 17:42:36 -05:00
bohanjason a9f1556184 fix ddpg 2020-02-26 17:42:36 -05:00
Dongsheng Yang 6c3b8643b4
fix the bug introduced by the last commit 2020-02-26 12:22:29 -05:00
yangdsh 286c9a9b5f update target for past invalid results in the last commit 2020-02-25 20:46:37 -05:00
yangdsh 0d103a8e45 fix the name pattern of invalid results 2020-02-25 20:46:37 -05:00
yangdsh c3c359e6a4 fix the bug when comparing knobs when multiple results have the same knob 2020-02-25 20:46:37 -05:00
yangdsh 60a30c2f85 fix the bug in generating knob_data for invalid result 2020-02-25 20:46:37 -05:00
yangdsh 9b4bafb86f give more penalty to invalid configs 2020-02-25 20:46:37 -05:00
yangdsh 27a275e21e detect celery failure 2020-02-25 12:31:53 -05:00
yangdsh 2293fac4d3 fix bug when skipping workload mapping 2020-02-21 19:57:13 -05:00
dvanaken 07425da6e8 Fixed style 2020-02-20 17:16:04 -05:00
dvanaken ff488cae35 Updated parser unit tests. 2020-02-20 17:16:04 -05:00
dvanaken 944a0ccc8d Speedup parser 2020-02-20 17:16:04 -05:00
dvanaken 3bd6d03efe Increased length of function field in executiontime model from 32 to 64 2020-02-20 00:52:46 -05:00
arifiorino 70f2768797 Style fixes 2020-02-19 20:51:50 -05:00
arifiorino 8f382e22e8 Style fixes 2020-02-19 20:51:50 -05:00
arifiorino 96a7991766 Bug fixes 2020-02-19 20:51:50 -05:00
arifiorino a2a77f9a75 Store execution times 2020-02-19 20:51:50 -05:00
yangdsh f7e22ff5bb skip workload mapping when there is no workload 2020-02-18 15:55:28 -05:00
yangdsh 59b723ee83 increase waiting time for starting celery 2020-02-18 14:43:37 -05:00
yangdsh 8e399db587 ack late; check rabbitmq 2020-02-18 14:43:37 -05:00
yangdsh 010a3ff267 check celery on each request for result 2020-02-18 14:43:37 -05:00
bohanjason c8a537e9e0 fix task visualization 2020-02-10 12:08:31 -05:00
yangdsh c69fca77d6 address dana's comment 2020-02-08 18:56:34 -05:00
yangdsh c33625ca17 random->lhs when lacking data for GPR; fix editing session 2020-02-08 18:56:34 -05:00
yangdsh ae98fdcb32 increase the waiting time for celery restarts 2020-02-08 18:56:34 -05:00
yangdsh d0cf8b597d check celery status before running tasks 2020-02-08 18:56:34 -05:00
dvanaken 42fc5ebe3e Update celery commands 2020-02-08 17:31:29 -05:00
dvanaken 9a5dea806f Added new migration file to change type of Result.taskids field and cleaned up views.py 2020-02-08 17:31:29 -05:00
dvanaken 4d228f5765 Updated task_ids field from CharField to TextField type 2020-02-08 17:31:29 -05:00
dvanaken ec9066e5b2 Updated handling of celery task status in views 2020-02-08 17:31:29 -05:00
dvanaken d9e2806b9e Changes:
- website.celery: create celery app
- website.admin: do not unregister the djcelery models
- website.settings: added some new celery settings and updated others. Added 'celery.tasks' to our logging config which resolved the missing celery log messages issue
- website.async_tasks: removed redundant abstract task classes. Removed the settings that configured retries since do not handle retries in the tasks
2020-02-08 17:31:29 -05:00
dvanaken 7339d07a98 Updated celery package version requirements 2020-02-08 17:31:29 -05:00
dvanaken 06948089d2 Added new model to store execution times 2020-01-23 23:38:56 -05:00
bohanjason 6f0fcfd952 use gpflow in workload mapping 2020-01-22 13:13:32 -05:00
BohanZhang 25d1950e67 use GPFlow in workload mapping 2020-01-22 13:13:32 -05:00
yangdsh 389174302f fix hard coded target objective 2020-01-21 20:02:06 -05:00
Dana Van Aken 35160f2fb4 Upgraded Django from version 1.11.23 to 1.11.27 2020-01-19 06:33:25 -05:00
Dana Van Aken 1d8913f408 When converting a value in bytes to human-readable, if the conversion fails then log a warning and return the original value instead of raising an exception. 2020-01-19 02:43:55 -05:00
yangdsh c2d5cbadd6 rename hyperparameters and use them as defaults 2020-01-18 23:27:01 -05:00
yangdsh cb8c597818 fix format 2020-01-18 23:27:01 -05:00
yangdsh a3774af2c1 modify tests 2020-01-18 23:27:01 -05:00
yangdsh d3c7bb661d fix bugs 2020-01-18 23:27:01 -05:00
yangdsh 24194293bc make session hyperparameters editable on the website 2020-01-18 23:27:01 -05:00
dvanaken 6bf50b892d Moved dumpdata code from resetwebsite into its own mgmt command, ignore errors from stopcelery kill command, added backdoor method to dump website backend database and logfiles 2020-01-14 07:43:31 -05:00
dvanaken 9f9f2845d6 Fixed formatting 2020-01-13 17:21:56 -05:00
dvanaken 7b962c4065 Updated parser classes to not cache knob/metric catalogs and replaced all queries that filter for numeric metrics with the new MetricType.numeric() method. 2020-01-13 17:21:56 -05:00
dvanaken e1a41928f6 Fixed admin forms for Metric/KnobCatalog models. 2020-01-13 17:21:56 -05:00
dvanaken ee101d818e Added class methods to get numeric/nonnumeric metric types. 2020-01-13 17:21:56 -05:00
dvanaken bcad0fa017 Added CHOOSE to enumvals for Oracle parameter optimizer_mode 2020-01-13 10:09:31 -05:00
dvanaken 2f79bfdc17 Fixed parser to treat enum values as case-insensitive 2020-01-13 10:09:31 -05:00
dvanaken 16348d1c7a Updated fixtures, human-readable values values in knob/metric comparison view 2020-01-09 03:23:06 -05:00
dvanaken c33defa29a Updated oracle knob fixtures 2020-01-09 03:23:06 -05:00
dvanaken 4c6ec3f0fd checkpoint 2020-01-09 03:23:06 -05:00
dvanaken 433bb68f2f Added next few Oracle params 2020-01-09 03:23:06 -05:00
dvanaken e1da577ad0 Fixed formatting 2020-01-08 15:29:31 -05:00
dvanaken 9393fb7aca Fixed bugs and improved logging in config recommendation tasks/views 2020-01-08 15:29:31 -05:00
dvanaken 8cec62160f Create/format/save the recommended config for the latest result before the on_success method. 2020-01-08 15:29:31 -05:00
dvanaken 8001b658c9 Added management function similar to 'startcelery' except that it auto-reloads modified website files. 2020-01-07 04:04:06 -05:00
dvanaken 9fced864fe Updated Django settings: removed unused paths, fixed incorrect paths to media/template dirs, increased size of rotating log files from 50KB to 2MB and the number of backup files. 2020-01-03 07:32:28 -05:00
dvanaken 16acc35f54 Fix style 2019-12-21 06:47:48 +01:00
arifiorino d007d932b5 Added target objective to comparison 2019-12-21 06:11:29 +01:00
Bohan Zhang 9633b0e99c improve dnn 2019-12-20 19:08:16 +01:00
yangdsh 3a722df5e2 add missing columns in metrics 2019-12-17 10:02:49 +01:00
yangdsh 0aaa0d37f0 fix target objective for restart failure 2019-12-17 10:02:18 +01:00
dvanaken 2a7bc6145f Fixed db time target objective 2019-12-16 20:47:24 +01:00
yangdsh ade504dcc4 fix bug 2019-12-15 23:09:29 +01:00
yangdsh df86a9f3bc fix website tests 2019-12-15 23:09:29 +01:00
yangdsh 1ebcbf383e regenerate website test fixture 2019-12-15 23:09:29 +01:00
yangdsh 477c8e7682 revert a LOG 2019-12-15 23:09:29 +01:00
yangdsh 7cc0c40d92 isolate workloads of different projects 2019-12-15 23:09:29 +01:00
dvanaken fc4cf0e18b added new oracle knobs 2019-12-15 19:20:29 +01:00
bohanjason 38f44848af disable knob identification 2019-12-15 18:54:03 +01:00
bohanjason ddd97a0973 fix knob identification 2019-12-15 18:54:03 +01:00
bohanjason cae807cf62 add comment 2019-12-15 18:54:03 +01:00
bohanjason b2e530095e clean up 2019-12-15 18:54:03 +01:00
bohanjason d5f7ae65eb disable dummy encoder in knob identification 2019-12-15 18:54:03 +01:00
dvanaken a144069e6b shuffle lhs samples 2019-12-11 19:18:35 +01:00
bohanjason 6d76b22e3b support enum/boolean in GPR/DNN 2019-12-11 09:18:40 +01:00
dvanaken 4b37dec988 Fixed formatting 2019-12-11 00:40:06 +01:00
dvanaken ffc88bfaae Run ddpg++ by default 2019-12-11 00:40:06 +01:00
dvanaken 65f3a7b0d6 Finished adding support for Oracle enums 2019-12-11 00:40:06 +01:00