Commit Graph

320 Commits

Author SHA1 Message Date
dvanaken efa02899b5 When ranking knobs in the background tasks use the target objective(s) by default. Added an option that when enabled also uses the pruned metrics. 2020-04-14 11:49:02 -04:00
dvanaken aeaae7d9f4 When aggregating knobs/metrics order the columns by name to ensure matrices have consistent columnnames in case they're combined in subsequent tasks. 2020-04-14 11:28:38 -04:00
dvanaken ff0efd7482 Fixed lint errors 2020-04-13 17:30:19 -04:00
dvanaken 4e1233ded2 Added a new textfield to the BackupData model to save additional (not required) files uploaded by the user. 2020-04-13 17:30:19 -04:00
yangdsh 52843f6fc3 use default config in tuning 2020-04-13 14:29:45 -04:00
yangdsh 147ef58065 fix a bug in clean_knob_data() 2020-04-13 11:09:32 -04:00
yangdsh 9fe6ded36c accelerate calculation; default per session 2020-04-13 11:02:06 -04:00
yangdsh d09489e8b6 make dba_hist backward compatible; add dba_hist in fixtures 2020-04-09 15:51:07 -04:00
yangdsh e5113f73f5 use dba_hist (continue) 2020-04-09 15:51:07 -04:00
yangdsh e0cb1ab8b0 use db_hist 2020-04-09 15:51:07 -04:00
Dongsheng Yang ef719dffe0 fix lint 2020-04-08 16:19:53 -04:00
Dongsheng Yang df29ce238e fix bugs 2020-04-08 16:19:53 -04:00
Dongsheng Yang 4fd1abbe6f modify target objective (db time) 2020-04-08 16:19:53 -04:00
bohanjason b711914bd6 fix dependency 2020-04-08 13:30:56 -04:00
bohanjason b8a7dae72b fix typo in ui test 2020-04-08 13:30:56 -04:00
bohanjason 814561573b task status ui tests 2020-04-08 13:30:56 -04:00
bohanjason 516d02006a add task status ui test 2020-04-08 13:30:56 -04:00
bohanjason adfee76977 disable celery task meta cleanup 2020-04-08 13:30:56 -04:00
dvanaken 593c4acb1d fixed lint errors 2020-04-03 03:56:59 -04:00
dvanaken 6d123d7509 Bug fix: pass single result object to save_execution_time() 2020-04-03 03:56:59 -04:00
dvanaken 94dcc0530d Fixed lint errors 2020-04-03 03:56:59 -04:00
dvanaken 78c2fa283a Return http error if views.give_result() is called and it's not a tuning session and updated .gitignore 2020-04-03 03:56:59 -04:00
dvanaken 72580f65a0 Startcelery mgmt cmd now pipes output to logfile only if 'console' handler is not present in the Django LOGGING settings. Also updated stopcelery warnings to make it clear they are just warnings not errors. 2020-04-03 03:56:59 -04:00
dvanaken 66ad361654 Fixed super verbose celery log messages and updated Django options to also log messages to the console. 2020-04-03 03:56:59 -04:00
dvanaken 423140169f Made the workload editable so it can be edited in the admin view and cleaned up the admin view and template 2020-04-03 01:50:38 -04:00
arifiorino 94fd374ec7 Fixed results table links 2020-03-30 12:56:31 -04:00
yangdsh 0461610ebd load knob range 2020-03-27 21:44:00 -04:00
yangdsh b4e5fb2e66 fix ddpg 2020-03-23 13:05:37 -04:00
yangdsh 56860d6364 deal with invalid results 2020-03-23 13:05:37 -04:00
bohanjason e123158eb6 fix visualization 2020-03-23 12:32:05 -04:00
dvanaken 8eb79c3cc4 Fixed lint errors 2020-03-19 21:52:51 -04:00
dvanaken c423a4d435 Compute all available target objectives and include them in metrics 2020-03-19 21:52:51 -04:00
yangdsh 240be46d58 do not use range_test results for tuning 2020-03-19 17:13:30 -04:00
yangdsh 52f4a5801e fix a few bugs 2020-03-19 17:13:30 -04:00
yangdsh 931541d594 change tests 2020-03-11 12:31:06 -04:00
yangdsh 0baaefeb92 fix bugs when number of tunable knobs changes or are inconsistent 2020-03-11 12:31:06 -04:00
yangdsh 1c4cc0c3ed resolve conflict of migration files 2020-03-10 15:52:13 -04:00
yangdsh af2cab8b03 fix edit_knob test 2020-03-10 15:52:13 -04:00
yangdsh d581703375 fix bug of finding worst result when there is no result 2020-03-10 15:52:13 -04:00
yangdsh e5e42a4ed6 fix bug of finding worst result when there is no valid result 2020-03-10 15:52:13 -04:00
yangdsh 029ad0f633 Refactoring: move preprocessing to a new celery task 2020-03-10 15:52:13 -04:00
yangdsh cebc958666 search for knob ranges 2020-03-10 15:52:13 -04:00
bohanjason 9ee71ea58a add pipeline data in results 2020-03-06 15:12:15 -05:00
bohanjason be9307822e pipeline data view in results 2020-03-06 15:12:15 -05:00
bohanjason 84407eb999 add pipeline data view 2020-03-06 15:12:15 -05:00
Dana Van Aken f61021c32f Fixed setting of session knobs to be case-insensitive and added git commit hash to server info 2020-03-05 17:28:33 -05:00
Dana Van Aken f737a0493e Added backdoor method to get webserver info 2020-03-05 17:28:33 -05:00
dvanaken ae5ab0b9e0 Cleanup backdoor methods 2020-03-03 19:57:14 -05:00
yangdsh b86e39b15f fix bugs in the parser and in copying result 2020-03-02 13:29:05 -05:00
bohanjason 21971e673f fix ddpg metrics 2020-02-26 17:42:36 -05:00
bohanjason a9f1556184 fix ddpg 2020-02-26 17:42:36 -05:00
Dongsheng Yang 6c3b8643b4
fix the bug introduced by the last commit 2020-02-26 12:22:29 -05:00
yangdsh 286c9a9b5f update target for past invalid results in the last commit 2020-02-25 20:46:37 -05:00
yangdsh 0d103a8e45 fix the name pattern of invalid results 2020-02-25 20:46:37 -05:00
yangdsh c3c359e6a4 fix the bug when comparing knobs when multiple results have the same knob 2020-02-25 20:46:37 -05:00
yangdsh 60a30c2f85 fix the bug in generating knob_data for invalid result 2020-02-25 20:46:37 -05:00
yangdsh 9b4bafb86f give more penalty to invalid configs 2020-02-25 20:46:37 -05:00
yangdsh 27a275e21e detect celery failure 2020-02-25 12:31:53 -05:00
yangdsh 2293fac4d3 fix bug when skipping workload mapping 2020-02-21 19:57:13 -05:00
dvanaken 07425da6e8 Fixed style 2020-02-20 17:16:04 -05:00
dvanaken ff488cae35 Updated parser unit tests. 2020-02-20 17:16:04 -05:00
dvanaken 944a0ccc8d Speedup parser 2020-02-20 17:16:04 -05:00
dvanaken 3bd6d03efe Increased length of function field in executiontime model from 32 to 64 2020-02-20 00:52:46 -05:00
arifiorino 70f2768797 Style fixes 2020-02-19 20:51:50 -05:00
arifiorino 8f382e22e8 Style fixes 2020-02-19 20:51:50 -05:00
arifiorino 96a7991766 Bug fixes 2020-02-19 20:51:50 -05:00
arifiorino a2a77f9a75 Store execution times 2020-02-19 20:51:50 -05:00
yangdsh f7e22ff5bb skip workload mapping when there is no workload 2020-02-18 15:55:28 -05:00
yangdsh 59b723ee83 increase waiting time for starting celery 2020-02-18 14:43:37 -05:00
yangdsh 8e399db587 ack late; check rabbitmq 2020-02-18 14:43:37 -05:00
yangdsh 010a3ff267 check celery on each request for result 2020-02-18 14:43:37 -05:00
bohanjason c8a537e9e0 fix task visualization 2020-02-10 12:08:31 -05:00
yangdsh c69fca77d6 address dana's comment 2020-02-08 18:56:34 -05:00
yangdsh c33625ca17 random->lhs when lacking data for GPR; fix editing session 2020-02-08 18:56:34 -05:00
yangdsh ae98fdcb32 increase the waiting time for celery restarts 2020-02-08 18:56:34 -05:00
yangdsh d0cf8b597d check celery status before running tasks 2020-02-08 18:56:34 -05:00
dvanaken 42fc5ebe3e Update celery commands 2020-02-08 17:31:29 -05:00
dvanaken 9a5dea806f Added new migration file to change type of Result.taskids field and cleaned up views.py 2020-02-08 17:31:29 -05:00
dvanaken 4d228f5765 Updated task_ids field from CharField to TextField type 2020-02-08 17:31:29 -05:00
dvanaken ec9066e5b2 Updated handling of celery task status in views 2020-02-08 17:31:29 -05:00
dvanaken d9e2806b9e Changes:
- website.celery: create celery app
- website.admin: do not unregister the djcelery models
- website.settings: added some new celery settings and updated others. Added 'celery.tasks' to our logging config which resolved the missing celery log messages issue
- website.async_tasks: removed redundant abstract task classes. Removed the settings that configured retries since do not handle retries in the tasks
2020-02-08 17:31:29 -05:00
dvanaken 7339d07a98 Updated celery package version requirements 2020-02-08 17:31:29 -05:00
dvanaken 06948089d2 Added new model to store execution times 2020-01-23 23:38:56 -05:00
bohanjason 6f0fcfd952 use gpflow in workload mapping 2020-01-22 13:13:32 -05:00
BohanZhang 25d1950e67 use GPFlow in workload mapping 2020-01-22 13:13:32 -05:00
yangdsh 389174302f fix hard coded target objective 2020-01-21 20:02:06 -05:00
Dana Van Aken 35160f2fb4 Upgraded Django from version 1.11.23 to 1.11.27 2020-01-19 06:33:25 -05:00
Dana Van Aken 1d8913f408 When converting a value in bytes to human-readable, if the conversion fails then log a warning and return the original value instead of raising an exception. 2020-01-19 02:43:55 -05:00
yangdsh c2d5cbadd6 rename hyperparameters and use them as defaults 2020-01-18 23:27:01 -05:00
yangdsh cb8c597818 fix format 2020-01-18 23:27:01 -05:00
yangdsh a3774af2c1 modify tests 2020-01-18 23:27:01 -05:00
yangdsh d3c7bb661d fix bugs 2020-01-18 23:27:01 -05:00
yangdsh 24194293bc make session hyperparameters editable on the website 2020-01-18 23:27:01 -05:00
dvanaken 6bf50b892d Moved dumpdata code from resetwebsite into its own mgmt command, ignore errors from stopcelery kill command, added backdoor method to dump website backend database and logfiles 2020-01-14 07:43:31 -05:00
dvanaken 9f9f2845d6 Fixed formatting 2020-01-13 17:21:56 -05:00
dvanaken 7b962c4065 Updated parser classes to not cache knob/metric catalogs and replaced all queries that filter for numeric metrics with the new MetricType.numeric() method. 2020-01-13 17:21:56 -05:00
dvanaken e1a41928f6 Fixed admin forms for Metric/KnobCatalog models. 2020-01-13 17:21:56 -05:00
dvanaken ee101d818e Added class methods to get numeric/nonnumeric metric types. 2020-01-13 17:21:56 -05:00
dvanaken bcad0fa017 Added CHOOSE to enumvals for Oracle parameter optimizer_mode 2020-01-13 10:09:31 -05:00
dvanaken 2f79bfdc17 Fixed parser to treat enum values as case-insensitive 2020-01-13 10:09:31 -05:00