dvanaken
78c2fa283a
Return http error if views.give_result() is called and it's not a tuning session and updated .gitignore
2020-04-03 03:56:59 -04:00
dvanaken
72580f65a0
Startcelery mgmt cmd now pipes output to logfile only if 'console' handler is not present in the Django LOGGING settings. Also updated stopcelery warnings to make it clear they are just warnings not errors.
2020-04-03 03:56:59 -04:00
dvanaken
66ad361654
Fixed super verbose celery log messages and updated Django options to also log messages to the console.
2020-04-03 03:56:59 -04:00
dvanaken
423140169f
Made the workload editable so it can be edited in the admin view and cleaned up the admin view and template
2020-04-03 01:50:38 -04:00
dvanaken
8eb79c3cc4
Fixed lint errors
2020-03-19 21:52:51 -04:00
dvanaken
c423a4d435
Compute all available target objectives and include them in metrics
2020-03-19 21:52:51 -04:00
Dana Van Aken
f61021c32f
Fixed setting of session knobs to be case-insensitive and added git commit hash to server info
2020-03-05 17:28:33 -05:00
Dana Van Aken
f737a0493e
Added backdoor method to get webserver info
2020-03-05 17:28:33 -05:00
dvanaken
ae5ab0b9e0
Cleanup backdoor methods
2020-03-03 19:57:14 -05:00
dvanaken
07425da6e8
Fixed style
2020-02-20 17:16:04 -05:00
dvanaken
ff488cae35
Updated parser unit tests.
2020-02-20 17:16:04 -05:00
dvanaken
944a0ccc8d
Speedup parser
2020-02-20 17:16:04 -05:00
dvanaken
8768686d17
Added rule for new migration file to pylintrc
2020-02-20 00:52:46 -05:00
dvanaken
3bd6d03efe
Increased length of function field in executiontime model from 32 to 64
2020-02-20 00:52:46 -05:00
dvanaken
42fc5ebe3e
Update celery commands
2020-02-08 17:31:29 -05:00
dvanaken
9a5dea806f
Added new migration file to change type of Result.taskids field and cleaned up views.py
2020-02-08 17:31:29 -05:00
dvanaken
4d228f5765
Updated task_ids field from CharField to TextField type
2020-02-08 17:31:29 -05:00
dvanaken
ec9066e5b2
Updated handling of celery task status in views
2020-02-08 17:31:29 -05:00
dvanaken
d9e2806b9e
Changes:
...
- website.celery: create celery app
- website.admin: do not unregister the djcelery models
- website.settings: added some new celery settings and updated others. Added 'celery.tasks' to our logging config which resolved the missing celery log messages issue
- website.async_tasks: removed redundant abstract task classes. Removed the settings that configured retries since do not handle retries in the tasks
2020-02-08 17:31:29 -05:00
dvanaken
7339d07a98
Updated celery package version requirements
2020-02-08 17:31:29 -05:00
dvanaken
06948089d2
Added new model to store execution times
2020-01-23 23:38:56 -05:00
Dana Van Aken
0cbc7ba334
travis-ci: trigger a build in the other repository instead of cloning and building it here
2020-01-23 16:15:49 -05:00
Dana Van Aken
6b78b8a131
Added 'set -e' to the top of docker/install.sh so bash exits if there are any errors during package installation.
2020-01-19 08:52:14 -05:00
Dana Van Aken
286046e2df
Save the latest git commit ID inside the Docker containers to /app/.git_commit
2020-01-19 08:52:14 -05:00
Dana Van Aken
35160f2fb4
Upgraded Django from version 1.11.23 to 1.11.27
2020-01-19 06:33:25 -05:00
Dana Van Aken
1d8913f408
When converting a value in bytes to human-readable, if the conversion fails then log a warning and return the original value instead of raising an exception.
2020-01-19 02:43:55 -05:00
dvanaken
6bf50b892d
Moved dumpdata code from resetwebsite into its own mgmt command, ignore errors from stopcelery kill command, added backdoor method to dump website backend database and logfiles
2020-01-14 07:43:31 -05:00
dvanaken
9f9f2845d6
Fixed formatting
2020-01-13 17:21:56 -05:00
dvanaken
7b962c4065
Updated parser classes to not cache knob/metric catalogs and replaced all queries that filter for numeric metrics with the new MetricType.numeric() method.
2020-01-13 17:21:56 -05:00
dvanaken
e1a41928f6
Fixed admin forms for Metric/KnobCatalog models.
2020-01-13 17:21:56 -05:00
dvanaken
ee101d818e
Added class methods to get numeric/nonnumeric metric types.
2020-01-13 17:21:56 -05:00
dvanaken
a4f8e0b37e
Cleanup old celery processes in docker/start.sh
2020-01-13 17:21:56 -05:00
dvanaken
bcad0fa017
Added CHOOSE to enumvals for Oracle parameter optimizer_mode
2020-01-13 10:09:31 -05:00
dvanaken
2f79bfdc17
Fixed parser to treat enum values as case-insensitive
2020-01-13 10:09:31 -05:00
dvanaken
2adab245c0
added create_knob_settings.py script to pylint exclude list
2020-01-09 03:23:06 -05:00
dvanaken
16348d1c7a
Updated fixtures, human-readable values values in knob/metric comparison view
2020-01-09 03:23:06 -05:00
dvanaken
c33defa29a
Updated oracle knob fixtures
2020-01-09 03:23:06 -05:00
dvanaken
4c6ec3f0fd
checkpoint
2020-01-09 03:23:06 -05:00
dvanaken
433bb68f2f
Added next few Oracle params
2020-01-09 03:23:06 -05:00
dvanaken
e1da577ad0
Fixed formatting
2020-01-08 15:29:31 -05:00
dvanaken
9393fb7aca
Fixed bugs and improved logging in config recommendation tasks/views
2020-01-08 15:29:31 -05:00
dvanaken
3786714093
Updated handling of next config in the driver
2020-01-08 15:29:31 -05:00
dvanaken
8cec62160f
Create/format/save the recommended config for the latest result before the on_success method.
2020-01-08 15:29:31 -05:00
dvanaken
8001b658c9
Added management function similar to 'startcelery' except that it auto-reloads modified website files.
2020-01-07 04:04:06 -05:00
dvanaken
9fced864fe
Updated Django settings: removed unused paths, fixed incorrect paths to media/template dirs, increased size of rotating log files from 50KB to 2MB and the number of backup files.
2020-01-03 07:32:28 -05:00
dvanaken
16acc35f54
Fix style
2019-12-21 06:47:48 +01:00
dvanaken
2a7bc6145f
Fixed db time target objective
2019-12-16 20:47:24 +01:00
dvanaken
fc4cf0e18b
added new oracle knobs
2019-12-15 19:20:29 +01:00
dvanaken
1994a09a6e
update docker-compose create script
2019-12-11 19:18:35 +01:00
dvanaken
24a8bbb298
add dev packages to install.sh
2019-12-11 19:18:35 +01:00
dvanaken
a144069e6b
shuffle lhs samples
2019-12-11 19:18:35 +01:00
dvanaken
d25d5b4cca
Expose rabbitmq host in docker
2019-12-11 19:18:35 +01:00
dvanaken
4b37dec988
Fixed formatting
2019-12-11 00:40:06 +01:00
dvanaken
ffc88bfaae
Run ddpg++ by default
2019-12-11 00:40:06 +01:00
dvanaken
c4e8eb53a1
Fixed docker tag for base image in travis
2019-12-11 00:40:06 +01:00
dvanaken
65f3a7b0d6
Finished adding support for Oracle enums
2019-12-11 00:40:06 +01:00
dvanaken
a3cc34ba8e
Updated oracle fixtures
2019-12-10 18:01:56 +01:00
dvanaken
42e1a4add3
Make constants editable
2019-12-10 18:01:56 +01:00
dvanaken
a7724233d3
fixed formatting
2019-12-09 22:19:47 +01:00
dvanaken
b0cddcc289
Added 3 Oracle hidden knobs
2019-12-09 22:19:47 +01:00
dvanaken
02c40f5cea
Adjusted background task time
2019-12-05 20:46:02 -05:00
dvanaken
783b94cd4d
Speedup travis-ci tests
2019-12-05 20:46:02 -05:00
dvanaken
9e9c9c7510
Fixed bug when collecting session knobs; for LHS sessions, remove all pre-generated configs if the session knobs are modified
2019-12-05 20:46:02 -05:00
dvanaken
7be5b89975
Changes: when we deploy our docker images we now also build/deploy the internal driver image; fixed .dockerignore; moved integration test data into the driver; fixed cast in oracle db_time target objective.
2019-12-04 17:27:05 -05:00
dvanaken
c739eb066e
Changes: removed docker centos image; updated expected value used in test in analysis/tests/ddpg_test.py to be less strict; run all tests on travis vm and docker containers; push docker images to docker-hub repo if on the master branch;
2019-12-03 18:33:04 -05:00
dvanaken
e80639c859
Fixed formatting
2019-11-26 15:25:06 -05:00
dvanaken
9994a22f16
Updated management commands
2019-11-26 15:25:06 -05:00
dvanaken
4ab2fdfd52
Updated knob tunability getter
2019-11-26 15:25:06 -05:00
dvanaken
c23308e9f1
Fixed log output
2019-11-26 05:15:44 -05:00
dvanaken
b211ad455d
Fixed bug caused by stale value of latest result in views.give_result()
2019-11-26 05:15:44 -05:00
dvanaken
5555ead3a3
Fixed small bug in parser.
2019-11-22 15:12:54 -05:00
dvanaken
a0c60afc3c
Addressed Dongsheng's review comments.
2019-11-18 13:04:14 -05:00
dvanaken
6a58c52762
formatting
2019-11-18 13:04:14 -05:00
dvanaken
9a4bbeead5
...formatting
2019-11-18 13:04:14 -05:00
dvanaken
a008428903
formatting
2019-11-18 13:04:14 -05:00
dvanaken
2a3b075516
fixed formatting
2019-11-18 13:04:14 -05:00
dvanaken
9055516737
Updating Oracle knobs/metrics
2019-11-18 13:04:14 -05:00
dvanaken
a99cf72c6c
Updated oracle tunable knobs
2019-11-18 13:04:14 -05:00
dvanaken
a5cbb50521
fixed formatting
2019-11-18 13:04:14 -05:00
dvanaken
cf19380107
Updated the knob/metric output samples for each of the Oracle versions we support since my fix changed all of them.
2019-11-18 13:04:14 -05:00
dvanaken
e1b29eaafa
Added support for Oracle v12.1c.
2019-11-18 13:04:14 -05:00
dvanaken
d874ca6a8b
The Oracle collector now prepends the view name to each metric to avoid overwriting metrics from different views with the same names
2019-11-18 13:04:14 -05:00
dvanaken
6283186d76
Driver now works when the database system is local, remote, or on docker
2019-11-18 13:04:14 -05:00
dvanaken
8ee52a64bf
Changed the format of the driver config from JSON to a python settings file to make it easier to update / read.
2019-11-18 13:04:14 -05:00
dvanaken
159e26e1c7
Removed old LHS code from driver (the website already supports running LHS)
2019-11-18 13:04:14 -05:00
dvanaken
fcec765a7c
Fixing new error in TravisCI builds that happens when installing the Pip package: mysqlclient==1.3.12
2019-11-18 12:28:39 -05:00
dvanaken
67a4a70c09
small fix
2019-11-08 05:49:19 -05:00
dvanaken
abbc589880
removed invalid field
2019-11-08 05:49:19 -05:00
dvanaken
4171a662f5
Added backdoor functions for creating/editing/deleting users/projects/sessions in the website and driver.
2019-11-08 05:49:19 -05:00
dvanaken
b261cf2139
Added migration for LHS
2019-11-06 21:05:33 -05:00
Dana Van Aken
2974cdab2b
Update pylintrc
...
Added the migrations directory and manage.py to the ignore list
2019-10-24 18:30:20 -04:00
dvanaken
7d8dcaee47
This shold fix the error from running git reset on an invalid TRAVIS_COMMIT_RANGE from empty commits and rebases
2019-10-24 00:54:38 -04:00
dvanaken
cc421ab959
pass required travis var into the docker container
2019-10-24 00:54:38 -04:00
dvanaken
5c855faa3e
Testing gitlint
2019-10-24 00:54:38 -04:00
dvanaken
9f3fe29c27
added the compression option to the main settings file
2019-10-23 22:41:55 -04:00
dvanaken
40024b4d3c
Added an option to enable compression on MySQL tables (disabled by default)
2019-10-23 22:41:55 -04:00
dvanaken
ec896d01f6
Updated MySQL-specific migration that enables compression to be non-atomic
2019-10-23 22:41:55 -04:00
dvanaken
777c42c979
Bumped numpy from 1.13.1 to 1.14.0 to satisfy TF 1.12.2 dependency. Updated grep commands in validator to also be compatible with BSD.
2019-10-22 19:45:39 -04:00
Dana Van Aken
dcb3152ec5
Added valid target objectives to the session create/edit form
2019-10-14 19:08:43 -04:00
Dana Van Aken
2b9f199c6f
Call makemigrations before running our Django tests
2019-10-14 19:08:43 -04:00
dvanaken