efa02899b5
When ranking knobs in the background tasks use the target objective(s) by default. Added an option that when enabled also uses the pruned metrics.
2020-04-14 11:49:02 -04:00
aeaae7d9f4
When aggregating knobs/metrics order the columns by name to ensure matrices have consistent columnnames in case they're combined in subsequent tasks.
2020-04-14 11:28:38 -04:00
ff0efd7482
Fixed lint errors
2020-04-13 17:30:19 -04:00
4e1233ded2
Added a new textfield to the BackupData model to save additional (not required) files uploaded by the user.
2020-04-13 17:30:19 -04:00
52843f6fc3
use default config in tuning
2020-04-13 14:29:45 -04:00
147ef58065
fix a bug in clean_knob_data()
2020-04-13 11:09:32 -04:00
9fe6ded36c
accelerate calculation; default per session
2020-04-13 11:02:06 -04:00
d09489e8b6
make dba_hist backward compatible; add dba_hist in fixtures
2020-04-09 15:51:07 -04:00
e5113f73f5
use dba_hist (continue)
2020-04-09 15:51:07 -04:00
e0cb1ab8b0
use db_hist
2020-04-09 15:51:07 -04:00
ef719dffe0
fix lint
2020-04-08 16:19:53 -04:00
df29ce238e
fix bugs
2020-04-08 16:19:53 -04:00
4fd1abbe6f
modify target objective (db time)
2020-04-08 16:19:53 -04:00
b711914bd6
fix dependency
2020-04-08 13:30:56 -04:00
b8a7dae72b
fix typo in ui test
2020-04-08 13:30:56 -04:00
814561573b
task status ui tests
2020-04-08 13:30:56 -04:00
516d02006a
add task status ui test
2020-04-08 13:30:56 -04:00
adfee76977
disable celery task meta cleanup
2020-04-08 13:30:56 -04:00
593c4acb1d
fixed lint errors
2020-04-03 03:56:59 -04:00
6d123d7509
Bug fix: pass single result object to save_execution_time()
2020-04-03 03:56:59 -04:00
94dcc0530d
Fixed lint errors
2020-04-03 03:56:59 -04:00
78c2fa283a
Return http error if views.give_result() is called and it's not a tuning session and updated .gitignore
2020-04-03 03:56:59 -04:00
72580f65a0
Startcelery mgmt cmd now pipes output to logfile only if 'console' handler is not present in the Django LOGGING settings. Also updated stopcelery warnings to make it clear they are just warnings not errors.
2020-04-03 03:56:59 -04:00
66ad361654
Fixed super verbose celery log messages and updated Django options to also log messages to the console.
2020-04-03 03:56:59 -04:00
423140169f
Made the workload editable so it can be edited in the admin view and cleaned up the admin view and template
2020-04-03 01:50:38 -04:00
94fd374ec7
Fixed results table links
2020-03-30 12:56:31 -04:00
0461610ebd
load knob range
2020-03-27 21:44:00 -04:00
b4e5fb2e66
fix ddpg
2020-03-23 13:05:37 -04:00
56860d6364
deal with invalid results
2020-03-23 13:05:37 -04:00
e123158eb6
fix visualization
2020-03-23 12:32:05 -04:00
8eb79c3cc4
Fixed lint errors
2020-03-19 21:52:51 -04:00
c423a4d435
Compute all available target objectives and include them in metrics
2020-03-19 21:52:51 -04:00
240be46d58
do not use range_test results for tuning
2020-03-19 17:13:30 -04:00
52f4a5801e
fix a few bugs
2020-03-19 17:13:30 -04:00
931541d594
change tests
2020-03-11 12:31:06 -04:00
0baaefeb92
fix bugs when number of tunable knobs changes or are inconsistent
2020-03-11 12:31:06 -04:00
1c4cc0c3ed
resolve conflict of migration files
2020-03-10 15:52:13 -04:00
af2cab8b03
fix edit_knob test
2020-03-10 15:52:13 -04:00
d581703375
fix bug of finding worst result when there is no result
2020-03-10 15:52:13 -04:00
e5e42a4ed6
fix bug of finding worst result when there is no valid result
2020-03-10 15:52:13 -04:00
029ad0f633
Refactoring: move preprocessing to a new celery task
2020-03-10 15:52:13 -04:00
cebc958666
search for knob ranges
2020-03-10 15:52:13 -04:00
9ee71ea58a
add pipeline data in results
2020-03-06 15:12:15 -05:00
be9307822e
pipeline data view in results
2020-03-06 15:12:15 -05:00
84407eb999
add pipeline data view
2020-03-06 15:12:15 -05:00
f61021c32f
Fixed setting of session knobs to be case-insensitive and added git commit hash to server info
2020-03-05 17:28:33 -05:00
f737a0493e
Added backdoor method to get webserver info
2020-03-05 17:28:33 -05:00
ae5ab0b9e0
Cleanup backdoor methods
2020-03-03 19:57:14 -05:00
b86e39b15f
fix bugs in the parser and in copying result
2020-03-02 13:29:05 -05:00
21971e673f
fix ddpg metrics
2020-02-26 17:42:36 -05:00
a9f1556184
fix ddpg
2020-02-26 17:42:36 -05:00
6c3b8643b4
fix the bug introduced by the last commit
2020-02-26 12:22:29 -05:00
286c9a9b5f
update target for past invalid results in the last commit
2020-02-25 20:46:37 -05:00
0d103a8e45
fix the name pattern of invalid results
2020-02-25 20:46:37 -05:00
c3c359e6a4
fix the bug when comparing knobs when multiple results have the same knob
2020-02-25 20:46:37 -05:00
60a30c2f85
fix the bug in generating knob_data for invalid result
2020-02-25 20:46:37 -05:00
9b4bafb86f
give more penalty to invalid configs
2020-02-25 20:46:37 -05:00
27a275e21e
detect celery failure
2020-02-25 12:31:53 -05:00
2293fac4d3
fix bug when skipping workload mapping
2020-02-21 19:57:13 -05:00
07425da6e8
Fixed style
2020-02-20 17:16:04 -05:00
ff488cae35
Updated parser unit tests.
2020-02-20 17:16:04 -05:00
944a0ccc8d
Speedup parser
2020-02-20 17:16:04 -05:00
3bd6d03efe
Increased length of function field in executiontime model from 32 to 64
2020-02-20 00:52:46 -05:00
70f2768797
Style fixes
2020-02-19 20:51:50 -05:00
8f382e22e8
Style fixes
2020-02-19 20:51:50 -05:00
96a7991766
Bug fixes
2020-02-19 20:51:50 -05:00
a2a77f9a75
Store execution times
2020-02-19 20:51:50 -05:00
f7e22ff5bb
skip workload mapping when there is no workload
2020-02-18 15:55:28 -05:00
59b723ee83
increase waiting time for starting celery
2020-02-18 14:43:37 -05:00
8e399db587
ack late; check rabbitmq
2020-02-18 14:43:37 -05:00
010a3ff267
check celery on each request for result
2020-02-18 14:43:37 -05:00
c8a537e9e0
fix task visualization
2020-02-10 12:08:31 -05:00
c69fca77d6
address dana's comment
2020-02-08 18:56:34 -05:00
c33625ca17
random->lhs when lacking data for GPR; fix editing session
2020-02-08 18:56:34 -05:00
ae98fdcb32
increase the waiting time for celery restarts
2020-02-08 18:56:34 -05:00
d0cf8b597d
check celery status before running tasks
2020-02-08 18:56:34 -05:00
42fc5ebe3e
Update celery commands
2020-02-08 17:31:29 -05:00
9a5dea806f
Added new migration file to change type of Result.taskids field and cleaned up views.py
2020-02-08 17:31:29 -05:00
4d228f5765
Updated task_ids field from CharField to TextField type
2020-02-08 17:31:29 -05:00
ec9066e5b2
Updated handling of celery task status in views
2020-02-08 17:31:29 -05:00
d9e2806b9e
Changes:
...
- website.celery: create celery app
- website.admin: do not unregister the djcelery models
- website.settings: added some new celery settings and updated others. Added 'celery.tasks' to our logging config which resolved the missing celery log messages issue
- website.async_tasks: removed redundant abstract task classes. Removed the settings that configured retries since do not handle retries in the tasks
2020-02-08 17:31:29 -05:00
7339d07a98
Updated celery package version requirements
2020-02-08 17:31:29 -05:00
06948089d2
Added new model to store execution times
2020-01-23 23:38:56 -05:00
6f0fcfd952
use gpflow in workload mapping
2020-01-22 13:13:32 -05:00
25d1950e67
use GPFlow in workload mapping
2020-01-22 13:13:32 -05:00
389174302f
fix hard coded target objective
2020-01-21 20:02:06 -05:00
35160f2fb4
Upgraded Django from version 1.11.23 to 1.11.27
2020-01-19 06:33:25 -05:00
1d8913f408
When converting a value in bytes to human-readable, if the conversion fails then log a warning and return the original value instead of raising an exception.
2020-01-19 02:43:55 -05:00
c2d5cbadd6
rename hyperparameters and use them as defaults
2020-01-18 23:27:01 -05:00
cb8c597818
fix format
2020-01-18 23:27:01 -05:00
a3774af2c1
modify tests
2020-01-18 23:27:01 -05:00
d3c7bb661d
fix bugs
2020-01-18 23:27:01 -05:00
24194293bc
make session hyperparameters editable on the website
2020-01-18 23:27:01 -05:00
6bf50b892d
Moved dumpdata code from resetwebsite into its own mgmt command, ignore errors from stopcelery kill command, added backdoor method to dump website backend database and logfiles
2020-01-14 07:43:31 -05:00
9f9f2845d6
Fixed formatting
2020-01-13 17:21:56 -05:00
7b962c4065
Updated parser classes to not cache knob/metric catalogs and replaced all queries that filter for numeric metrics with the new MetricType.numeric() method.
2020-01-13 17:21:56 -05:00
e1a41928f6
Fixed admin forms for Metric/KnobCatalog models.
2020-01-13 17:21:56 -05:00
ee101d818e
Added class methods to get numeric/nonnumeric metric types.
2020-01-13 17:21:56 -05:00
bcad0fa017
Added CHOOSE to enumvals for Oracle parameter optimizer_mode
2020-01-13 10:09:31 -05:00
2f79bfdc17
Fixed parser to treat enum values as case-insensitive
2020-01-13 10:09:31 -05:00
dvanaken
yangdsh
Dongsheng Yang
bohanjason
arifiorino
BohanZhang