100 Commits
Author SHA1 Message Date
Dongsheng Yang bfa0cd124e fix hyperparams loading issue 2020-07-28 20:38:13 -04:00
yangdsh c31b9f2490 fix style 2020-05-27 11:29:45 -04:00
yangdsh 3b1ddb26c9 add concurrency test 2020-05-27 11:29:45 -04:00
yangdsh 70b9a7c566 change test condition 2020-05-27 11:29:45 -04:00
yangdsh ae85ea26a1 fix test 2020-05-27 11:29:45 -04:00
yangdsh c9d3642e6a address Bohan's comment 2020-05-27 11:29:45 -04:00
yangdsh a0089cccdf fix style 2020-05-27 11:29:45 -04:00
yangdsh 8bc1d68a26 fix a major ddpg bug happening on some machines 2020-05-27 11:29:45 -04:00
yangdsh 96347e217c Upgrade integration tests for testing algorithm performance 2020-05-27 11:29:45 -04:00
yangdsh 4b0d452719 improve UI for visualizing SocGen sessions 2020-05-27 11:29:45 -04:00
Dongsheng Yang 5b697b9c56 Update utils.py 2020-05-05 14:36:21 -04:00
yangdsh 4e290c9548 clean up convert_dbms_metrics; fix invalid results handling bug 2020-04-28 17:22:40 -04:00
yangdsh 285522a0f5 clean metrics for DDPG 2020-04-28 17:22:40 -04:00
yangdsh 2916330e89 dump session target objectives to csv 2020-04-28 13:57:35 -04:00
yangdsh 3584dff8d8 fix db time 2020-04-27 16:16:06 -04:00
yangdsh 3f0c82abbd reload default metrics in normalized_db_time object 2020-04-27 16:16:06 -04:00
yangdsh 37e0d58ce0 fix knob_range_search lowerbound 2020-04-24 11:45:50 -04:00
yangdsh 5df71fb436 fix first normalized_db_time unequal to raw_db_time 2020-04-22 13:36:27 -04:00
yangdsh 93d6fa5339 fix unit test 2020-04-22 13:36:27 -04:00
yangdsh 77eb5cdb42 address dana's comment 2020-04-22 13:36:27 -04:00
yangdsh e7d5b0338a clean metrics before pruning 2020-04-22 13:36:27 -04:00
yangdsh 8da203fdc3 address dana's comment 2020-04-21 20:39:06 -04:00
yangdsh 33f78f7302 pass concurrency option to celery worker 2020-04-21 20:39:06 -04:00
yangdsh efcc2ee74b fix rabbitmq hostname 2020-04-21 20:39:06 -04:00
yangdsh 288805aae3 upload and download ddpg models 2020-04-16 22:12:22 -04:00
yangdsh ad96c03902 address dana's comment 2020-04-16 13:51:51 -04:00
yangdsh 2f7396d275 fix tests 2020-04-16 13:51:51 -04:00
yangdsh 0bf2da738f do not allow mapping to the same workload; remove important_knob_num 2020-04-16 13:51:51 -04:00
yangdsh ec67e739d8 amend last commit 2020-04-15 02:04:18 -04:00
yangdsh 9361e0d1ab fix bug 2020-04-15 02:04:18 -04:00
yangdsh fd6dc1ea54 fix original ddpg 2020-04-15 02:04:18 -04:00
yangdsh 52843f6fc3 use default config in tuning 2020-04-13 14:29:45 -04:00
yangdsh 147ef58065 fix a bug in clean_knob_data() 2020-04-13 11:09:32 -04:00
yangdsh 9fe6ded36c accelerate calculation; default per session 2020-04-13 11:02:06 -04:00
yangdsh d09489e8b6 make dba_hist backward compatible; add dba_hist in fixtures 2020-04-09 15:51:07 -04:00
yangdsh e5113f73f5 use dba_hist (continue) 2020-04-09 15:51:07 -04:00
yangdsh e0cb1ab8b0 use db_hist 2020-04-09 15:51:07 -04:00
yangdsh 0461610ebd load knob range 2020-03-27 21:44:00 -04:00
yangdsh b4e5fb2e66 fix ddpg 2020-03-23 13:05:37 -04:00
yangdsh 56860d6364 deal with invalid results 2020-03-23 13:05:37 -04:00
yangdsh 240be46d58 do not use range_test results for tuning 2020-03-19 17:13:30 -04:00
yangdsh 52f4a5801e fix a few bugs 2020-03-19 17:13:30 -04:00
yangdsh 931541d594 change tests 2020-03-11 12:31:06 -04:00
yangdsh 0baaefeb92 fix bugs when number of tunable knobs changes or are inconsistent 2020-03-11 12:31:06 -04:00
yangdsh 1c4cc0c3ed resolve conflict of migration files 2020-03-10 15:52:13 -04:00
yangdsh af2cab8b03 fix edit_knob test 2020-03-10 15:52:13 -04:00
yangdsh d581703375 fix bug of finding worst result when there is no result 2020-03-10 15:52:13 -04:00
yangdsh e5e42a4ed6 fix bug of finding worst result when there is no valid result 2020-03-10 15:52:13 -04:00
yangdsh 029ad0f633 Refactoring: move preprocessing to a new celery task 2020-03-10 15:52:13 -04:00
yangdsh cebc958666 search for knob ranges 2020-03-10 15:52:13 -04:00
yangdsh b86e39b15f fix bugs in the parser and in copying result 2020-03-02 13:29:05 -05:00
Dongsheng Yang 6c3b8643b4 fix the bug introduced by the last commit 2020-02-26 12:22:29 -05:00
yangdsh 286c9a9b5f update target for past invalid results in the last commit 2020-02-25 20:46:37 -05:00
yangdsh 0d103a8e45 fix the name pattern of invalid results 2020-02-25 20:46:37 -05:00
yangdsh c3c359e6a4 fix the bug when comparing knobs when multiple results have the same knob 2020-02-25 20:46:37 -05:00
yangdsh 60a30c2f85 fix the bug in generating knob_data for invalid result 2020-02-25 20:46:37 -05:00
yangdsh 9b4bafb86f give more penalty to invalid configs 2020-02-25 20:46:37 -05:00
yangdsh 27a275e21e detect celery failure 2020-02-25 12:31:53 -05:00
yangdsh 2293fac4d3 fix bug when skipping workload mapping 2020-02-21 19:57:13 -05:00
yangdsh f7e22ff5bb skip workload mapping when there is no workload 2020-02-18 15:55:28 -05:00
yangdsh 59b723ee83 increase waiting time for starting celery 2020-02-18 14:43:37 -05:00
yangdsh 8e399db587 ack late; check rabbitmq 2020-02-18 14:43:37 -05:00
yangdsh 010a3ff267 check celery on each request for result 2020-02-18 14:43:37 -05:00
yangdsh c69fca77d6 address dana's comment 2020-02-08 18:56:34 -05:00
yangdsh c33625ca17 random->lhs when lacking data for GPR; fix editing session 2020-02-08 18:56:34 -05:00
yangdsh ae98fdcb32 increase the waiting time for celery restarts 2020-02-08 18:56:34 -05:00
yangdsh d0cf8b597d check celery status before running tasks 2020-02-08 18:56:34 -05:00
yangdsh 389174302f fix hard coded target objective 2020-01-21 20:02:06 -05:00
yangdsh c2d5cbadd6 rename hyperparameters and use them as defaults 2020-01-18 23:27:01 -05:00
yangdsh cb8c597818 fix format 2020-01-18 23:27:01 -05:00
yangdsh a3774af2c1 modify tests 2020-01-18 23:27:01 -05:00
yangdsh d3c7bb661d fix bugs 2020-01-18 23:27:01 -05:00
yangdsh 24194293bc make session hyperparameters editable on the website 2020-01-18 23:27:01 -05:00
yangdsh 3a722df5e2 add missing columns in metrics 2019-12-17 10:02:49 +01:00
yangdsh 0aaa0d37f0 fix target objective for restart failure 2019-12-17 10:02:18 +01:00
yangdsh 1cc7537b2a ignore the migration file in pylint 2019-12-15 23:09:29 +01:00
yangdsh ade504dcc4 fix bug 2019-12-15 23:09:29 +01:00
yangdsh df86a9f3bc fix website tests 2019-12-15 23:09:29 +01:00
yangdsh 1ebcbf383e regenerate website test fixture 2019-12-15 23:09:29 +01:00
yangdsh 477c8e7682 revert a LOG 2019-12-15 23:09:29 +01:00
yangdsh 7cc0c40d92 isolate workloads of different projects 2019-12-15 23:09:29 +01:00
yangdsh d1a9933808 fix bug 2019-12-10 17:54:54 +01:00
yangdsh 7ade03e3e5 fix bugs 2019-12-10 10:14:01 +01:00
yangdsh 642d7c3875 fix enum bug 2019-12-10 10:14:01 +01:00
yangdsh 1250732add resolve conflicts 2019-12-05 03:45:18 -05:00
yangdsh 5579d8d94f restore CDBTune 2019-12-05 03:45:18 -05:00
yangdsh c4433181f7 fix format 2019-12-03 21:28:13 -05:00
yangdsh 4e5db94697 move restart location; auto fix knob range 2019-12-03 21:28:13 -05:00
yangdsh 13735c9b0b fix bugs 2019-12-03 17:28:35 -05:00
yangdsh e47508d20b change knob catelog when changing session knob tunability 2019-11-25 17:55:15 -05:00
yangdsh 73cd8489f7 fix variable name 2019-11-25 13:22:54 -05:00
yangdsh 69dacaf193 make simulation interface consistent with website 2019-11-25 13:22:54 -05:00
yangdsh b149684d77 add GPFLOW to website 2019-11-25 13:22:54 -05:00
yangdsh dceee6e0ba support Oracle flash back; auto-fix metric type; compile ojdbc 2019-11-25 13:17:53 -05:00
yangdsh 27f9cb55fd fix bug in simulation.py 2019-11-22 20:04:04 +00:00
yangdsh f34e879cb1 python style 2019-11-21 00:02:11 -05:00
yangdsh f0c6d7ef1f accelerate simulation; scale beta 2019-11-21 00:02:11 -05:00
yangdsh 21fce27291 improve ddpg 2019-11-18 10:51:22 -05:00
yangdsh ee53d0cead remove contextual gpr 2019-11-04 03:15:33 -05:00
yangdsh e86fce59d9 import Dana's new gpr model 2019-11-04 03:15:33 -05:00