Dana Van Aken
f737a0493e
Added backdoor method to get webserver info
2020-03-05 17:28:33 -05:00
dvanaken
ae5ab0b9e0
Cleanup backdoor methods
2020-03-03 19:57:14 -05:00
dvanaken
07425da6e8
Fixed style
2020-02-20 17:16:04 -05:00
dvanaken
ff488cae35
Updated parser unit tests.
2020-02-20 17:16:04 -05:00
dvanaken
944a0ccc8d
Speedup parser
2020-02-20 17:16:04 -05:00
dvanaken
8768686d17
Added rule for new migration file to pylintrc
2020-02-20 00:52:46 -05:00
dvanaken
3bd6d03efe
Increased length of function field in executiontime model from 32 to 64
2020-02-20 00:52:46 -05:00
dvanaken
42fc5ebe3e
Update celery commands
2020-02-08 17:31:29 -05:00
dvanaken
9a5dea806f
Added new migration file to change type of Result.taskids field and cleaned up views.py
2020-02-08 17:31:29 -05:00
dvanaken
4d228f5765
Updated task_ids field from CharField to TextField type
2020-02-08 17:31:29 -05:00
dvanaken
ec9066e5b2
Updated handling of celery task status in views
2020-02-08 17:31:29 -05:00
dvanaken
d9e2806b9e
Changes:
...
- website.celery: create celery app
- website.admin: do not unregister the djcelery models
- website.settings: added some new celery settings and updated others. Added 'celery.tasks' to our logging config which resolved the missing celery log messages issue
- website.async_tasks: removed redundant abstract task classes. Removed the settings that configured retries since do not handle retries in the tasks
2020-02-08 17:31:29 -05:00
dvanaken
7339d07a98
Updated celery package version requirements
2020-02-08 17:31:29 -05:00
dvanaken
06948089d2
Added new model to store execution times
2020-01-23 23:38:56 -05:00
Dana Van Aken
0cbc7ba334
travis-ci: trigger a build in the other repository instead of cloning and building it here
2020-01-23 16:15:49 -05:00
Dana Van Aken
6b78b8a131
Added 'set -e' to the top of docker/install.sh so bash exits if there are any errors during package installation.
2020-01-19 08:52:14 -05:00
Dana Van Aken
286046e2df
Save the latest git commit ID inside the Docker containers to /app/.git_commit
2020-01-19 08:52:14 -05:00
Dana Van Aken
35160f2fb4
Upgraded Django from version 1.11.23 to 1.11.27
2020-01-19 06:33:25 -05:00
Dana Van Aken
1d8913f408
When converting a value in bytes to human-readable, if the conversion fails then log a warning and return the original value instead of raising an exception.
2020-01-19 02:43:55 -05:00
dvanaken
6bf50b892d
Moved dumpdata code from resetwebsite into its own mgmt command, ignore errors from stopcelery kill command, added backdoor method to dump website backend database and logfiles
2020-01-14 07:43:31 -05:00
dvanaken
9f9f2845d6
Fixed formatting
2020-01-13 17:21:56 -05:00
dvanaken
7b962c4065
Updated parser classes to not cache knob/metric catalogs and replaced all queries that filter for numeric metrics with the new MetricType.numeric() method.
2020-01-13 17:21:56 -05:00
dvanaken
e1a41928f6
Fixed admin forms for Metric/KnobCatalog models.
2020-01-13 17:21:56 -05:00
dvanaken
ee101d818e
Added class methods to get numeric/nonnumeric metric types.
2020-01-13 17:21:56 -05:00
dvanaken
a4f8e0b37e
Cleanup old celery processes in docker/start.sh
2020-01-13 17:21:56 -05:00
dvanaken
bcad0fa017
Added CHOOSE to enumvals for Oracle parameter optimizer_mode
2020-01-13 10:09:31 -05:00
dvanaken
2f79bfdc17
Fixed parser to treat enum values as case-insensitive
2020-01-13 10:09:31 -05:00
dvanaken
2adab245c0
added create_knob_settings.py script to pylint exclude list
2020-01-09 03:23:06 -05:00
dvanaken
16348d1c7a
Updated fixtures, human-readable values values in knob/metric comparison view
2020-01-09 03:23:06 -05:00
dvanaken
c33defa29a
Updated oracle knob fixtures
2020-01-09 03:23:06 -05:00
dvanaken
4c6ec3f0fd
checkpoint
2020-01-09 03:23:06 -05:00
dvanaken
433bb68f2f
Added next few Oracle params
2020-01-09 03:23:06 -05:00
dvanaken
e1da577ad0
Fixed formatting
2020-01-08 15:29:31 -05:00
dvanaken
9393fb7aca
Fixed bugs and improved logging in config recommendation tasks/views
2020-01-08 15:29:31 -05:00
dvanaken
3786714093
Updated handling of next config in the driver
2020-01-08 15:29:31 -05:00
dvanaken
8cec62160f
Create/format/save the recommended config for the latest result before the on_success method.
2020-01-08 15:29:31 -05:00
dvanaken
8001b658c9
Added management function similar to 'startcelery' except that it auto-reloads modified website files.
2020-01-07 04:04:06 -05:00
dvanaken
9fced864fe
Updated Django settings: removed unused paths, fixed incorrect paths to media/template dirs, increased size of rotating log files from 50KB to 2MB and the number of backup files.
2020-01-03 07:32:28 -05:00
dvanaken
16acc35f54
Fix style
2019-12-21 06:47:48 +01:00
dvanaken
2a7bc6145f
Fixed db time target objective
2019-12-16 20:47:24 +01:00
dvanaken
fc4cf0e18b
added new oracle knobs
2019-12-15 19:20:29 +01:00
dvanaken
1994a09a6e
update docker-compose create script
2019-12-11 19:18:35 +01:00
dvanaken
24a8bbb298
add dev packages to install.sh
2019-12-11 19:18:35 +01:00
dvanaken
a144069e6b
shuffle lhs samples
2019-12-11 19:18:35 +01:00
dvanaken
d25d5b4cca
Expose rabbitmq host in docker
2019-12-11 19:18:35 +01:00
dvanaken
4b37dec988
Fixed formatting
2019-12-11 00:40:06 +01:00
dvanaken
ffc88bfaae
Run ddpg++ by default
2019-12-11 00:40:06 +01:00
dvanaken
c4e8eb53a1
Fixed docker tag for base image in travis
2019-12-11 00:40:06 +01:00
dvanaken
65f3a7b0d6
Finished adding support for Oracle enums
2019-12-11 00:40:06 +01:00
dvanaken
a3cc34ba8e
Updated oracle fixtures
2019-12-10 18:01:56 +01:00
dvanaken
42e1a4add3
Make constants editable
2019-12-10 18:01:56 +01:00
dvanaken
a7724233d3
fixed formatting
2019-12-09 22:19:47 +01:00
dvanaken
b0cddcc289
Added 3 Oracle hidden knobs
2019-12-09 22:19:47 +01:00
dvanaken
02c40f5cea
Adjusted background task time
2019-12-05 20:46:02 -05:00
dvanaken
783b94cd4d
Speedup travis-ci tests
2019-12-05 20:46:02 -05:00
dvanaken
9e9c9c7510
Fixed bug when collecting session knobs; for LHS sessions, remove all pre-generated configs if the session knobs are modified
2019-12-05 20:46:02 -05:00
dvanaken
7be5b89975
Changes: when we deploy our docker images we now also build/deploy the internal driver image; fixed .dockerignore; moved integration test data into the driver; fixed cast in oracle db_time target objective.
2019-12-04 17:27:05 -05:00
dvanaken
c739eb066e
Changes: removed docker centos image; updated expected value used in test in analysis/tests/ddpg_test.py to be less strict; run all tests on travis vm and docker containers; push docker images to docker-hub repo if on the master branch;
2019-12-03 18:33:04 -05:00
dvanaken
e80639c859
Fixed formatting
2019-11-26 15:25:06 -05:00
dvanaken
9994a22f16
Updated management commands
2019-11-26 15:25:06 -05:00
dvanaken
4ab2fdfd52
Updated knob tunability getter
2019-11-26 15:25:06 -05:00
dvanaken
c23308e9f1
Fixed log output
2019-11-26 05:15:44 -05:00
dvanaken
b211ad455d
Fixed bug caused by stale value of latest result in views.give_result()
2019-11-26 05:15:44 -05:00
dvanaken
5555ead3a3
Fixed small bug in parser.
2019-11-22 15:12:54 -05:00
dvanaken
a0c60afc3c
Addressed Dongsheng's review comments.
2019-11-18 13:04:14 -05:00
dvanaken
6a58c52762
formatting
2019-11-18 13:04:14 -05:00
dvanaken
9a4bbeead5
...formatting
2019-11-18 13:04:14 -05:00
dvanaken
a008428903
formatting
2019-11-18 13:04:14 -05:00
dvanaken
2a3b075516
fixed formatting
2019-11-18 13:04:14 -05:00
dvanaken
9055516737
Updating Oracle knobs/metrics
2019-11-18 13:04:14 -05:00
dvanaken
a99cf72c6c
Updated oracle tunable knobs
2019-11-18 13:04:14 -05:00
dvanaken
a5cbb50521
fixed formatting
2019-11-18 13:04:14 -05:00
dvanaken
cf19380107
Updated the knob/metric output samples for each of the Oracle versions we support since my fix changed all of them.
2019-11-18 13:04:14 -05:00
dvanaken
e1b29eaafa
Added support for Oracle v12.1c.
2019-11-18 13:04:14 -05:00
dvanaken
d874ca6a8b
The Oracle collector now prepends the view name to each metric to avoid overwriting metrics from different views with the same names
2019-11-18 13:04:14 -05:00
dvanaken
6283186d76
Driver now works when the database system is local, remote, or on docker
2019-11-18 13:04:14 -05:00
dvanaken
8ee52a64bf
Changed the format of the driver config from JSON to a python settings file to make it easier to update / read.
2019-11-18 13:04:14 -05:00
dvanaken
159e26e1c7
Removed old LHS code from driver (the website already supports running LHS)
2019-11-18 13:04:14 -05:00
dvanaken
fcec765a7c
Fixing new error in TravisCI builds that happens when installing the Pip package: mysqlclient==1.3.12
2019-11-18 12:28:39 -05:00
dvanaken
67a4a70c09
small fix
2019-11-08 05:49:19 -05:00
dvanaken
abbc589880
removed invalid field
2019-11-08 05:49:19 -05:00
dvanaken
4171a662f5
Added backdoor functions for creating/editing/deleting users/projects/sessions in the website and driver.
2019-11-08 05:49:19 -05:00
dvanaken
b261cf2139
Added migration for LHS
2019-11-06 21:05:33 -05:00
Dana Van Aken
2974cdab2b
Update pylintrc
...
Added the migrations directory and manage.py to the ignore list
2019-10-24 18:30:20 -04:00
dvanaken
7d8dcaee47
This shold fix the error from running git reset on an invalid TRAVIS_COMMIT_RANGE from empty commits and rebases
2019-10-24 00:54:38 -04:00
dvanaken
cc421ab959
pass required travis var into the docker container
2019-10-24 00:54:38 -04:00
dvanaken
5c855faa3e
Testing gitlint
2019-10-24 00:54:38 -04:00
dvanaken
9f3fe29c27
added the compression option to the main settings file
2019-10-23 22:41:55 -04:00
dvanaken
40024b4d3c
Added an option to enable compression on MySQL tables (disabled by default)
2019-10-23 22:41:55 -04:00
dvanaken
ec896d01f6
Updated MySQL-specific migration that enables compression to be non-atomic
2019-10-23 22:41:55 -04:00
dvanaken
777c42c979
Bumped numpy from 1.13.1 to 1.14.0 to satisfy TF 1.12.2 dependency. Updated grep commands in validator to also be compatible with BSD.
2019-10-22 19:45:39 -04:00
Dana Van Aken
dcb3152ec5
Added valid target objectives to the session create/edit form
2019-10-14 19:08:43 -04:00
Dana Van Aken
2b9f199c6f
Call makemigrations before running our Django tests
2019-10-14 19:08:43 -04:00
Dana Van Aken
01b4ec3f53
Support adding custom target objectives to the website/db/*/target_objective.py modules
2019-10-14 19:08:43 -04:00
Dana Van Aken
f68c23e975
Added outer db module and moved parser code into it
2019-10-14 19:08:43 -04:00
Dana Van Aken
0da1b724cc
Added postgresql client package to Dockerfiles and psycopg2-binary to requirements.txt, removed unused matplotlib code/package from analysis/cluster.py and requirements.txt, replaced commands in docker start.sh file with new management commands.
2019-10-08 09:32:25 -04:00
Dana Van Aken
e8f28ebef0
Added another function that converts bytes/ms to human-readable values without loss of resolution.
2019-10-08 09:32:25 -04:00
Dana Van Aken
3d70990ff1
The calculation of maxval for session knobs that use memory/storage resources is now set to 80% of the available resource (versus 100%)
2019-10-08 09:32:25 -04:00
Dana Van Aken
c568c09c00
Enforce unique Project.name for same user and unique Session.name for same user and project
2019-10-08 09:32:25 -04:00
Dana Van Aken
40c75de3ce
Added additional Oracle views to metric collection (v, v).
2019-10-08 09:32:25 -04:00
Dana Van Aken