Release Notes¶
IMPORTANT: It's recommended to backup your database before performing any major version upgrade. Once the application has been upgraded, it cannot be downgraded.
There are several ways to backup the Elasticsearch database:
- Stop the database and backup the database files (located in docker volume
elasticsearch-data
by default) by preserving owners and permissions, - Perform a snapshot.
It's recommended to do both before upgrading.
12.1.1 (10th February 2021)¶
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:12.1.1
octoperf/enterprise-ui:12.1.1
octoperf/enterprise-documentation:12.1.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.10.2
octoperf/jmeter-standard:11.9.4
octoperf/jmeter-webdriver:11.9.4
Enhancements
- Backend clustering: fix a memory leak when using Hazelcast (#1492)
- Runtime: log a warning in test logs when there are not enough static IPs to assign to cloud instances (#1476)
Bug Fixes
- Sanity check: fix comparison of host header with server hostname and port (#1494)
- Setting a runtime property is now only allowed sequentially; concurrent updates are rejected (#1489)
- Fix
ContentTooLongException
when opening a project with virtual users containing thousands of requests (#1485)
12.1.0 (19th January 2021)¶
Elasticsearch has been upgraded from 7.4.2
to 7.10.2
.
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:12.1.0
octoperf/enterprise-ui:12.1.0
octoperf/enterprise-documentation:12.1.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.10.2
octoperf/jmeter-standard:11.9.4
octoperf/jmeter-webdriver:11.9.4
Enhancements
- Elasticsearch: upgrade from
7.4.2
to7.10.2
(#1310) - Auto-Correlation: improve algorithm speed by parallelizing computation (#1479)
- Update SAML and Token Correlation Frameworks (#988)
- Upgrade Java version to
11.0.9.1
(#1454) - Backend dependencies upgrade (#1454)
Bug Fixes
- Database: older snapshots may not be deleted when snapshot repository is slow (#1453)
- Design: list Virtual User may throw an error when many big virtual users are containing
2000+
requests (#1467) - UI: Usage Logs only displaying info for the first workspace (#1465)
12.0.4 (12th January 2021)¶
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:12.0.4
octoperf/enterprise-ui:12.0.4
octoperf/enterprise-documentation:12.0.4
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.4
octoperf/jmeter-webdriver:11.9.4
Enhancements
- Design: speedup Correlation Rules computation (#1463)
- Add version number to UI (#1440)
Bug Fixes
- Runtime: cloud instances may be stopped while a test is in PREPARING state (#1464)
- Analysis: Threshold table missing when creating report template (#1462)
- UI: fix display issue with VU selection in correlation rules pages (#1461)
- Wen link action is disabled, the linked action must be disabled too (#1456)
12.0.3 (4th December 2020)¶
This release is focused on improving disk space usage related to recorded requests and responses, error requests and responses, jmeter logs and project files.
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:12.0.3
octoperf/enterprise-ui:12.0.3
octoperf/enterprise-documentation:12.0.3
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.4
octoperf/jmeter-webdriver:11.9.4
Enhancements
- [Runtime] Limit the total number of detailed errors requests / responses stored via
octoperf.runtime.errors.max-per-test=500
(#1448) - [Runtime] Providers: new memory setting for "Heavy Virtual Users" (#1441)
- [Design] HAR Import: recorded responses of static resources are skipped to save disk space (#1438)
- [Validation] Virtual User validations are now stored within Elasticsearch by default (#1436)
- Elasticsearch: configurable client buffer limit (#1431)
Bug Fixes
- [Design] Delete project files when deleting a project (#1452)
- [Analysis] Delete files associated to a bench result when the result is deleted (#1451)
- [Runtime] Do not copy project files into result files when launching a test to reduce disk space usage (#1449)
- [Notifications] Post only distinct messages to avoid spamming slack channel (#1446)
- [Elasticsearch] Improved settings for default scroll size and timeout (#1444)
- [Migration] SLA Profiles weren't migrated to new metric format (#1443)
- [Notification] Typo in Test Started Slack message (#1442)
- [Design] Cyclic dependency when using fragment was detected but there was none (#1439)
12.0.2 (16th November 2020)¶
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:12.0.2
octoperf/enterprise-ui:12.0.2
octoperf/enterprise-documentation:12.0.2
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.4
octoperf/jmeter-webdriver:11.9.4
Enhancements
- [Elasticsearch] Configurable properties to adjust elasticsearch default scroll size / keep-alive (#1430)
- [UI] Display a notification when results are about to be removed as part of data eviction (#1424)
- [UI] Improve Correlation Rules Panel layout (#1417)
- [Admin] Allow Admin users to update Public providers (#1415)
- [Runtime] User profiles: replace browser label by the location (#1414)
Bug Fixes
- [Migration] Migrate SLA Monitor Connections to the new metric format (#1429)
- [Design] UI: back to previous page button not working in files panel (#1423)
- [Correlation Rules] Support url encoded / decoded values injection into HTTP headers (#1422)
- [Microsoft Azure] increase timeout when creating / starting container to prevent test launch failure (#1420)
- [Correlation Rules] Injecting several variables within the same field at once is not working (#1419)
- [Account] Ability to send a new activation email if the previous expired / was never received (#1413)
- [Correlation Rules] Implement variants (url encode / decode) in HTTP headers (#1412)
- [UI] Scheduler: use project tags by default (#1411)
- [UI] Workspaces drop-down: make it clear when more workspaces are existing (#1407)
- [Design] Support CSV with both columns in filename and defined as columns in variable (#1232)
12.0.1 (2nd November 2020)¶
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:12.0.1
octoperf/enterprise-ui:12.0.1
octoperf/enterprise-documentation:12.0.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.4
octoperf/jmeter-webdriver:11.9.4
Enhancements
- [Scheduler] Ability to run one-off tests (#1389)
- [Backend] Upgrade various internal dependencies to latest version (#1393)
Bug Fixes
- [Scheduler] UI: Cron expression ui validation can be bypassed sometimes (#1410)
- [Scheduler] UI: One-off tasks date picker is not in UTC (#1409)
- [Design] Debug Sampler: validation content is not displayed when opening it (#1408)
- [Design] UI: Variable auto-completion does refresh when creating a variable (#1405)
- [Design] UI: Due to a race condition, deleting a server may not delete associated requests (#1403)
- [Scheduler] Scheduled jobs next run are not refreshed when enabling / disabling it (#1402)
- [Admin] Admin panel only accessible after logout then login (#1401)
- [Saas] When a new user registers, the Free subscription is not tied to its account (#1399)
- [Audit Logs] when evicting audit logs is enabled, all logs are evicted (#1397)
- [Subscriptions] UI: hide Credit Card / Subscribe buttons in Enterprise (#1396)
- [Design] Server are not up to date in Virtual User when coming from servers page (#1395)
- [Design] UI: validation button are hidden when provider name is too long (#1394)
- [Scheduler] UI: timezone must be in UTC (#1391)
- [Admin] UI: Admin menu not working after clicking on profile (#1390)
12.0.0 (23rd October 2020)¶
This release introduces the following major features:
- Test Scheduler: schedule and periodically run your load tests, directly from the platform,
- Test Notifications: get notified by slack, email or webhook when a test is started, finished, passed or failed,
- Revamped Top Menu: new top menu with direct access to files, servers, scheduled tests, notifications and more,
- Account Email Activation: when a user registers a new account, email activation can now be enabled,
- Enterprise Free License: now, you can concurrently execute up to
10
user profiles in a single scenario (instead of2
).
This version migrates the users
indice. You cannot downgrade to 11.x.x
once upgraded to 12.0.x
.
Also, some settings have been changed, see migration guide/ for more information.
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:12.0.0
octoperf/enterprise-ui:12.0.0
octoperf/enterprise-documentation:12.0.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.4
octoperf/jmeter-webdriver:11.9.4
Enhancements
- [Analysis] New Metric: 80th centile (#1384)
- [Workspace] Get notified by slack, email or webhook when a test is started, finished, failed, passed or errored (#1365)
- [Elasticsearch] Support creating indices with aliases through config (#1358)
- [Design] JMeter JMX Import: enable / disable adblocking to filter undesirable requests (#1353)
- [User Account]when a user registers a new account, email activation can now be enabled (#1351)
- [User Account] Enrich Temporary Email Domains block list (#1350)
- [Runtime] Enable / Disable Audit logs eviction after XX months (#1349)
- [UI] Enable / Disable Browser Cache (#1347)
- [UI] New Top menu with direct access to servers, files, scenarios, notifications, scheduled tests and more (#1344)
- [Runtime] Test Scheduler: periodically run tests (#1288)
- [Saas] Allow users to upgrade their credit card (#1338)
- [Saas] Plans now have specific VAT for french customers (#1339)
Bug Fixes
- [Analysis] Dynamic Resources metrics not shown in report when using the override setting in scenario profiles (#1363)
- [Backend] Workspaces
lastModified
is not updated on save (#1362) - [User Account] Improve error message when login fails (#1357)
- [Backend] In some cases, cascading deletion is not propagated, orphaned data is left (#1348)
- [Profile] fix memory per VU displayed in subscription selection (#1346)
- [Runtime] Truncate userload name when they are too long (#1345)
- [License] License check may not pick optimal license
- [Runtime] AWS: exclude
us-east-1e
from zones as it doesn't havem5
instances (#1341)
11.9.4 (17th September 2020)¶
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:11.9.4
octoperf/enterprise-ui:11.9.4
octoperf/enterprise-documentation:11.9.4
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.4
octoperf/jmeter-webdriver:11.9.4
Enhancements
- [Runtime] Disable JMeter Cache Manager when
cacheSize <= 0
(#1333) - [Backend] upgrade all dependencies (#1325)
- [Design] Multipart Http Post: add browser compatibility headers option (#1319)
- [Design] Correlations Rules: handle values which need to be url decoded twice (#1313)
- [Design] Option to enable / disable filtering undesirable requests during HAR import (#1287)
- Support mixed case filenames (#1272)
Bug Fixes
- [Runtime] Automatically stop tests stuck in
PREPARING
state for more than20
minutes (#1332) - [Frontend] Youtube / Twitter API is called when loading Enterprise UI (#1326)
- [JMeter Import]
SetRuntimeProperty
action is imported as generic jmeter action (#1323) - Correlation Rules: do not uncheck
encode
option when applying correlation rules on query / post params (#1320) - [Validation] Query parameters without value are wrongly displayed with an equal sign (#1307)
- [Runtime] Encode reserved URI chars when within query parameters only (#1314)
- [Runtime] When using the same csv file in multiple shared csv variables, the file was split multiple times (#1312)
- Send a mail to warn that password was changed from OctoPerf backend (#144)
11.9.3 (25th August 2020)¶
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:11.9.3
octoperf/enterprise-ui:11.9.3
octoperf/enterprise-documentation:11.9.3
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.2
octoperf/jmeter-webdriver:11.9.2
Enhancements
- [Design] Move project from one workspace to another (#1301)
- [Design] Servers can be removed in bulk using search and replace (#1298)
Bug Fixes
- [Providers] When configuring provider regions, removing one region removes multiple ones (#1309)
- [Runtime] CSV is not splitted when used in setup / teardown only (#1306)
11.9.2 (22nd July 2020)¶
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:11.9.2
octoperf/enterprise-ui:11.9.2
octoperf/enterprise-documentation:11.9.2
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.2
octoperf/jmeter-webdriver:11.9.2
Enhancements
- [Runtime] AWS: support Milan - Italy - eu-south-1 (#1296)
- [Runtime] Launch cloud instances from different providers in parallel (#1278)
- [Runtime] Ability to increase all userloads at once (#1271)
- [Runtime] AWS: support Hong Kong (#989)
Bug Fixes
- [Runtime] Throughput Thinktime not computed correctly when set in hours (#1297)
- [Runtime] UI: summary report may not display correctly in some cases (#1295)
- [Runtime] Improved Throughput Thinktime label (#1294)
- [Runtime] Default report template is not applied when launching test (#1293)
- [Admin] UI: glitch when displaying user admin status (#1289)
- [Runtime] JMeter JMX: connect timeout is set with response timeout (#1286)
- [Runtime] SSH Keys are duplicate when launching DigitalOcean droplets (#1282)
- [Design] HAR Import:
.jsp
requests must not be filtered as resource (#1281) - [Runtime] Thinktime label in UI is misleading (#1280)
- Json Processor documentation link is broken (#1269)
- [UI] administration panel display issues (#1258)
11.9.1 (24th June 2020)¶
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:11.9.1
octoperf/enterprise-ui:11.9.1
octoperf/enterprise-documentation:11.9.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.2
octoperf/jmeter-webdriver:11.9.2
Enhancements
- [Backend] Upgrade to Spring Boot 2.3.1.RELEASE (#1260)
- [VU Validation] Disable Cache Manager during virtual user validation (#1276)
Bug Fixes
- [Design] JMX Import: authorization manager (#1277)
- [Runtime] JMeter: ParallelSampler plugin results are not working properly (#1275)
- [Runtime] Downgrade to JMeter
5.2.1
due to SSL issues with ParallelSampler plugin (#1274) - [Design] JMX: fragments are not exported correctly (#1273)
11.9.0 (12th June 2020)¶
This release introduces two majors features:
- Apache JMeter 5.3: upgraded from JMeter
5.2.1
to5.3
, - setUp and tearDown thread groups: profiles can now be configured to have a setUp and/or tearDown thread group.
This release also fixes a critical bug: monitoring may still continue even when test is stopped. (#1268)
Docker Images
octoperf/docker-agent:11.9.0
octoperf/enterprise-edition:11.9.0
octoperf/enterprise-ui:11.9.0
octoperf/enterprise-documentation:11.9.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.9.0
octoperf/jmeter-webdriver:11.9.0
Enhancements
- [Runtime] Upgrade to JMeter
5.3
(#1253) - [Design] Improve handling of JSR223 script with filename (#1262)
- [Runtime] JMeter:
httpsampler.embedded_resources_use_md5=true
by default (#1250) - [Runtime] AWS: enable Bahrain and South Africa regions (#1248)
Bug Fixes
- [Agent] Support Auto-upgrading agents running on ephemeral cloud instances (#1270)
- [Runtime] Monitoring may still be running even when the test has been stopped or is finished (#1268)
- [Analysis] UI: SLA Apdex field not removed with you switch to another type of metric (#1257)
- [Runtime] Finished JMeter containers not cleaned up at the end of the test (#1256)
- [Design] Set Property Action throws an error when using an empty key (#1246)
- [Design] UI: Module Controller is not properly enabled after import (#1245)
11.8.0 (15th May 2020)¶
This version highlights are:
- Improved Top report item with integrated charts,
- New
SetRuntimeProperty
action: easily update a runtime property from within your script, - Improved alerting on JMeter JVM heap use.
Docker Images
octoperf/docker-agent:11.7.1
octoperf/enterprise-edition:11.8.0
octoperf/enterprise-ui:11.8.0
octoperf/enterprise-documentation:11.8.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.8.0
octoperf/jmeter-webdriver:11.8.0
Enhancements
- Upgrade JMeter base image to Ubuntu
20.04LTS
(#1244) - Upgrade backend Dependencies to latest version (#1242)
- [Design] Hide groups in Regexp Extractor check (#1241)
- [Design] UI: do not open right aside panels on mouse hover (#1237)
- [Design] UI: Update style to improve tab visibility (#1236)
- [Analysis] UI: update default chart colors (#1235)
- [Design] Support JSR223 Script files (#1234)
- [Analysis] Improve Top Report Item by adding charts (#1226)
- [Design] New action: Set Runtime Property (#1224)
Bug Fixes
- [Runtime] Bench End date not properly sent by JMeter at the end of the test (#1243)
- [Runtime] Test stuck in INITIALIZING state when scenario created by a user not member of the workspace anymore (#1238)
- [Design] JMeter JMX: import csv columns in all cases (#1232)
- [Runtime] [Monitoring] Heap Memory Alert >= 90% even thought Heap Allocated is low (#1225)
11.7.1 (30rd April 2020)¶
Docker Images
octoperf/docker-agent:11.7.1
octoperf/enterprise-edition:11.7.1
octoperf/enterprise-ui:11.7.1
octoperf/enterprise-documentation:11.7.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.7.1
octoperf/jmeter-webdriver:11.7.1
Enhancements
- [Monitoring] Increase
% heap used
threshold to90%
(#1219) - [Design] HAR Import: support gzip compressed
.har.gz
HAR archives (#1216) - [Design] UI: Scroll bar when having many workspaces (#1207)
- [Design] HAR Import: support importing HAR in existing virtual user through API (#1217)
- [Analysis] Add 1min, 5min and 15min Load Average (#1215)
- [Analysis] Add Response Size metric to results tree / table (#1204)
Bug Fixes
- [Analysis] UI: Successful Hits metric name is mislabeled (#1210)
- [Runtime] CSV not detected as being used when variable used in assertion only (#1212)
- [System] Set
server.tomcat.max-http-form-post-size
to10MB
by default (#1214) - [Design] HAR / JMX Import: decode http request path if url encoded (#1209)
- [Runtime] Improve the way a cloud instance startup failure is handled (#1205)
- [Design] HAR Import issue: timing is out of int range (#1202)
11.7.0 (8th April 2020)¶
Docker Images
octoperf/docker-agent:11.7.0
octoperf/enterprise-edition:11.7.0
octoperf/enterprise-ui:11.7.0
octoperf/enterprise-documentation:11.7.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.7.0
octoperf/jmeter-webdriver:11.7.0
Enhancements
- [Runtime] Support Iteration Pacing Thinktime (#1192)
- [Analysis] UI: improve bench report labels (#1188)
- [Runtime] UI: Remember last selected bench report template when launching a test (#1193)
- [Design] Do not import disabled thread groups (#1184)
- [Runtime] Add JMeter JVM monitoring via JMX protocol (#1183)
- [Runtime] Improve Dynatrace headers integration (#1191)
- [Runtime] Microsoft Azure: images are now managed via Image Galleries (#1165)
- [Runtime] Confirmation before deleting a userload profile (#1178)
- [Design] Support Uploading zip archive (and unzipping them) from Files menu (#1181)
- [Runtime] Add AWS Seoul region (#1173)
- Upgrade backend dependencies (#1169, #1198)
- [Runtime] New option to enable / disable Dynamic Resources in Scenario settings (#1154)
- [Admin] Add
userId
to workspace management screen (#1158)
Bug Fixes
- [Design] UI: Change
content-type
header only if it's new (#1175) - [Monitoring] Linux: fix
segments retransmitted
counter not working (#1190) - [Design] UI: allow
.JMX
files when importing JMeter scripts (#1182) - [Design] UI: display not refreshed after removing files from Files menu (#1181)
- [System] Changing account email sometimes not working (#1177)
- [Design] UI: Disable If condition as variable expression by default (#1176)
- [Design] Fix JMeter 4.0 JMX Import issue (#1174)
- [Design] Fix JMX Import issue (#1171)
- [Runtime] store up to 20 errors per request during validation (#1164)
11.6.1 (2nd March 2020)¶
Docker Images
octoperf/docker-agent:11.5.1
octoperf/enterprise-edition:11.6.1
octoperf/enterprise-ui:11.6.1
octoperf/enterprise-documentation:11.6.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.6.1
octoperf/jmeter-webdriver:11.6.1
Enhancements
- [Analysis] Add Bench Report URL Endpoint to generate link to bench report (#1162)
- [Maven] Add report analysis template name to plugin parameters (#1147)
Bug Fixes
- [Design] JMX Import: fail to import XML containing null xml char
�
(#1163) - [Analysis] Duplicate Fragments response time is
0ms
in results tree (#1161) - [Runtime] CSV parsing issue when using tab delimiter (#1160)
- [Runtime] JMeter JMX Generator: Query parameters with
;
in value not parsed correctly (#1159) - [Payment] Subscriptions must be queried in a paginated way (#1155)
- [Design] Do not import Http
CONNECT
requests when importing HAR (#1153) - [UI] Display an error message when adding invalid user on workspace (#688)
11.6.0 (19th February 2020)¶
Docker Images
octoperf/docker-agent:11.5.1
octoperf/enterprise-edition:11.6.0
octoperf/enterprise-ui:11.6.0
octoperf/enterprise-documentation:11.6.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.5.2
octoperf/jmeter-webdriver:11.5.2
Enhancements
- [Design]
If
: add option to enable / disableinterpret as variable
option (#1140) - [Providers] Max Number of containers per host can be configured in provider memory settings (#1149)
- [Runtime] LG CPU Threshold set as WARNING when % CPU Usage
>= 80%
(#1141) - [Analysis] Compute sampling against total number of actions within virtual user profiles (#1138)
Bug Fixes
- [Analysis]
Follow Redirects
sub sample results not shown in tree (#1152) - [Analysis] Results tree is broken when using exclusive filters (#1143)
- [Validation] Green / Orange Dots are sometimes inconsistent (#1150)
- [Runtime] Terminating / shutting down all containers is now done without waiting the operation to finish (#1151)
- [Design] UI: fix display issue when tree is very deep / display is small (#1146)
- [Build] JAR Signature Certificate expiration date extended to year
2099
(#1148) - [Design] JMX Import: some ModuleController were not imported / were missing (#1145)
- [Runtime] Improve Test Launch Resiliency when agent fails to acknowledge container has been created (#1144)
- [Analysis] Top Report Item computation is incomplete (#1139)
11.5.2 (4th February 2020)¶
Docker Images
octoperf/docker-agent:11.5.1
octoperf/enterprise-edition:11.5.2
octoperf/enterprise-ui:11.5.2
octoperf/enterprise-documentation:11.5.2
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.5.2
octoperf/jmeter-webdriver:11.5.2
Bug Fixes
- [Validation] Post parameters seen in http query parameters (#1137)
- [Runtime] Execute
before-test.sh
script before splitting CSVs (#1135) - [Design] Fail to import / export TestAction properly in some edge cases (#1133)
- [UX] Add "Apply" button on popup windows (#1132)
- [Design] Removed element can be restored multiple times (#1129)
- [Design] Update Virtual user creation date in duplicate one (#1127)
- [System] Email Logo Update (#1126)
11.5.1 (28th January 2020)¶
Docker Images
octoperf/docker-agent:11.5.1
octoperf/enterprise-edition:11.5.1
octoperf/enterprise-ui:11.5.1
octoperf/enterprise-documentation:11.5.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.5.1
octoperf/jmeter-webdriver:11.5.1
Bug Fixes
- [Runtime]
SocketTimeout
in rendez-vous client when using a Proxy (#1125) - [Runtime] Fix possible NullPointer during validation when server hostname is invalid (#1124)
- [Runtime] Upgrade to OkHttp
4.3.1
which supports HTTP/2 protocol between docker-agent, jmeter-standard, jmeter-webdriver and backend (#1122) - [Analysis] Use request names when exporting Results Table CSV (#1121)
11.5.0 (23th January 2020)¶
Docker Images
octoperf/docker-agent:11.2.0
octoperf/enterprise-edition:11.5.0
octoperf/enterprise-ui:11.5.0
octoperf/enterprise-documentation:11.5.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.5.0
octoperf/jmeter-webdriver:11.5.0
Enhancements
- Upgrade various internal dependencies to latest stable version (#1119)
- [Design] JMeter JMX: import
CounterConfig
into variables (#1109) - [Admin] Add ability to manage all workspaces and members (#1108)
- [Analysis] Display runtime user profiles as YAML in report Synopsis (#1116)
- [Runtime] Test Logs: log which user aborts the test (#1113)
- [Authentication] add
users.administrators
property as coma separated usernames withADMIN
role (#1107) - [Design] Import JMeter HeaderManager as generic when not as Http Requests child (#1105)
- [Design] Copy Correlations Rules between projects (#1100)
- [Runtime] Disable HTTP Cache Control Headers by default (#1101)
- [Runtime] Ignore error when assertion with
assumeSuccess=true
(#1103)
Bug Fixes
- [Payment] Some subscriptions are not displayed when more than
10
(#1118) - [Runtime] Skip samples with
timestamp=0
to avoid messing up analysis report (#1114) - [Design] Regexp / JsonPath / Assertions check not working in Fragments (#1117)
- [Analysis] Close Report Configuration Dialog when clicking on
Apply
button (#1115) - [Runtime] Stopping a test might leave some JMeter containers running in rare cases (#1112)
- [Runtime] Use
UTF-8
as default encoding for CSVs / When reading files in JMeter (#1092) - [Design] Unlink private hosts provider from a workspace when workspace is deleted (#1110)
- [Runtime] Test Stuck in
PENDING
state when renaming an on-premise region and running test from old one (#1096) - [Runtime] Empty DNS hostname causes
NullPointerException
(#1104)
11.4.1 (7th January 2020)¶
Docker Images
octoperf/docker-agent:11.2.0
octoperf/enterprise-edition:11.4.1
octoperf/enterprise-ui:11.4.1
octoperf/enterprise-documentation:11.4.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.4.1
octoperf/jmeter-webdriver:11.4.1
Bug Fixes
- [Runtime] Prevent
StackOverflowError
when having an empty Link action (#1088) - [Design] UI: auto-completion in URLs Must Match download resources field (#1086)
11.4.0 (3rd December 2019)¶
Docker Images
octoperf/docker-agent:11.2.0
octoperf/enterprise-edition:11.4.0
octoperf/enterprise-ui:11.4.0
octoperf/enterprise-documentation:11.4.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.4.1
octoperf/jmeter-webdriver:11.4.1
Enhancements
- [Design] Increase Regexp Extractor default offset to
20
(#1085) - [Runtime] Return HTTP code
304 Not Modified
in validation when request is cached instead of200 OK
(#1084) - [Runtime] Download JMeter Plugins on the fly on JMeter side (#1082)
- [Runtime] Upgrade to JMeter
5.2.1
(#1077) - [Runtime] Improve Dynatrace APM HTTP headers (#1075)
- [Analysis] Display exact time (instead of "x days ago") in results list (#1072)
- [Runtime] Improve JMeter CPU Usage by reducing number of threads used to aggregate results (#1071)
- [Runtime] Decrease database pressure when virtual user profile contains 500+ requests (#1070)
Bug Fixes
- [Design] Add missing Http Status Codes in UI (#)
- [Runtime] Properly parse / split multiline CSV files (#1076)
- [Design] Import JMX generated by third party tools with alternate XML structure (#1074)
- [Runtime] Recover from DigitalOcean which fails to create droplet (#1067)
- [Runtime] JMeter URL Encoding issues in path with special chars (#890)
11.3.1 (14th November 2019)¶
Docker Images
octoperf/docker-agent:11.2.0
octoperf/enterprise-edition:11.3.1
octoperf/enterprise-ui:11.3.1
octoperf/enterprise-documentation:11.3.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.2.0
octoperf/jmeter-webdriver:11.2.0
Bug Fixes
- [Runtime] Disable
Clear DNS Cache
by default due to high CPU Usage (#1069) - [Design] JMX Import: support XML
1.1
escaped characters (#1066) - Update to Spring Boot
2.2.1.RELEASE
(#1064)
11.3.0 (6th November 2019)¶
This version includes the following new features:
- Analysis: new advanced metrics like
Network Time
, - Elasticsearch 7.4.2: the database is upgraded from version
7.4.0
to7.4.2
.
Docker Images
octoperf/docker-agent:11.2.0
octoperf/enterprise-edition:11.3.0
octoperf/enterprise-ui:11.3.0
octoperf/enterprise-documentation:11.3.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
octoperf/jmeter-standard:11.2.0
octoperf/jmeter-webdriver:11.2.0
Enhancements
- Upgrade various internal dependencies to latest stable version (#1061)
- [Design] UI: button to move a container to fragments (#1059)
- [Design] UI: minor productivity enhancements (#1056)
- [Design] Auto-Correlation: handle url encoding in request path (#1055)
- [Runtime] Enable
Clear DNS Cache
by default (#1052) - [Analysis] Add colors to metrics to quickly identify issues (#1048)
- [Analysis] Add new computed metrics (#1046)
- [Analysis] Add new metrics to default report template (#1045)
Bug Fixes
- [Design] Fragments: cycle detected when link points to removed action (#1060)
- [Design] Handle CSV with columns containing double quotes (#1058)
- [Analysis]
% Errors
computation is wrong (#1057) - [Design] Fragments: remove select all button when editing link (#1054)
- [Runtime] JMX: encode non-compliant chars in request path (#1053)
- [Design] UI: tags with spaces are not working (#1050)
- [Analysis] UI: fix strange characters in report export (#1049)
- [Runtime] UI: rename "+" to "Add User Profile" (#1044)
11.2.0 (22nd October 2019)¶
This version includes the following new features:
- Modular Scripts: add support for scripts modularity. Share parts of your scripts between multiple scripts to avoid script duplications,
- New Analysis Metrics: add
% successful hits
,% errors
,successful hits
anderrors hits
, - Cloud Instance Startup: improve speed by paralellizing cloud instance provisioning,
- Elasticsearch 7.4.0: the database is upgraded from version
7.1.1
to7.4.0
.
A Database migration is performed once on first server startup.
Docker Images
octoperf/docker-agent:11.2.0
octoperf/enterprise-edition:11.2.0
octoperf/enterprise-ui:11.2.0
octoperf/enterprise-documentation:11.2.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.0
octoperf/jmeter-standard:11.2.0
octoperf/jmeter-webdriver:11.2.0
Enhancements
- [Database] Upgrade to Elasticsearch
7.4.0
(#1040) - Upgrade various internal dependencies to latest stable version (#1036)
- [Runtime] Parallellize cloud instance provisioning (#1031)
- [Analysis] New Report metrics such as
% errors
(#716) - [Design] Modular Scripts (#329)
Bug Fixes
- [Design] JMX Import: take into account CSV Dataset Config
ignoreFirstLine
property (#1042) - [Runtime] Test stuck while in PENDING state due to thread starvation (#1037)
- [Agent] Fix: agent could not start container due to invalid generated name (#1034)
- [Analysis] Comparison Report HTTP call fails as
Method not allowed
(#1030) - [Backups] Deleting older Elasticsearch Snapshots fails (#1029)
- [Runtime] Generate non-offensive load generator names (#893)
11.1.0 (20th September 2019)¶
This version includes the following new features:
- Tag virtual users, scenarios and test reports,
- And Share on-premise providers with multiple workspaces.
A Database migration is performed once on first server startup.
Docker Images
octoperf/docker-agent:11.1.0
octoperf/enterprise-edition:11.1.0
octoperf/enterprise-ui:11.1.0
octoperf/enterprise-documentation:11.1.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
octoperf/jmeter-standard:11.1.0
octoperf/jmeter-webdriver:11.1.0
Enhancements
- [Design] Ability to tag virtual users, scenarios and test reports (#1011)
- [Admin] Ability to manage use accounts through admin console (#996)
- [Workspace] Ability to share a Private Hosts Provider with multiple workspaces (#1017)
- [Runtime] Convert csv and sh scripts with
dos2unix
to avoid charset issues (#1018) - [Backend] Upgrade internal libraries (#1023)
- [Design] Search and replace Post Parameters (#1019)
- [Config]
spring.security.debug
property to enabled security logs (#1012) - [Analysis] add percentiles to summary report item (#1010)
- [Payment] Stripe: support for 3D secure payment (#908)
- [Integrations] Support HTTP Webhook (#966)
Bug Fixes
- [Backup] Retry when failing to delete snapshot because another snapshot is running (#1029)
- [Runtime] Improve Error handling when failing to create container (#1022)
- [Runtime] JMX Export: do not include empty post parameters (#1028)
- [Design] JMX Import:
browser compatible headers
script must be in Groovy (#1025) - [Payment] Subscription audit logs HTTP Error 400 (#1015)
- [Design] JMX Import: fix duplicate variables imported by different users (#1013)
- Set
server.tomcat.internal_proxies
to fix Oauth2 authentication issues (#1008)
11.0.3 (3rd September 2019)¶
Docker Images
octoperf/docker-agent:11.0.0
octoperf/enterprise-edition:11.0.3
octoperf/enterprise-ui:11.0.3
octoperf/enterprise-documentation:11.0.3
docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
octoperf/jmeter-standard:11.0.2
octoperf/jmeter-webdriver:11.0.2
Enhancements
- [Design] Export list of HTTP servers as CSV (#1003)
Bug Fixes
- [Security] Oauth2 authentication often fails due to old remaining cookies / session (#1008)
- [Security] Oauth2 authentication doesn't work when Hazelcast clustering is enabled (#1007)
- [Security] Cannot login using Oauth2 when registration is disabled (#1005)
- [Design] Remove incorrect tooltip on NTLM authentication (#1002)
- [Design] Providers: rename
Memory
toTotal Amount of memory
(#1001) - [Design] JMX Export: CSV not included when variable used in IP Spoofing (#1000)
- [Analysis] Active users curves are desync in comparison reports (#999)
- [Analysis] UI: Threshold line for LG monitoring has no label (#992)
11.0.2 (21th August 2019)¶
Docker Images
octoperf/docker-agent:11.0.0
octoperf/enterprise-edition:11.0.2
octoperf/enterprise-ui:11.0.2
octoperf/enterprise-documentation:11.0.2
docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
octoperf/jmeter-standard:11.0.2
octoperf/jmeter-webdriver:11.0.2
Enhancements
- [Design] Search: ability to search requests by server hostname (#595)
- [Validation] Design: add support for Debug Sampler (#970)
- [Runtime] Improve retry on error when container fails to create on remote agent (#981)
- [Runtime] AWS: use
m5
andt3
instances by default in all regions (#982) - [Design] UI: Support multipart filename parameter as variable (#975)
- [Runtime] UI: update predefined user-agents (#967)
- UI: fix various typos (#974)
- [Design] JMX Import: whitelist Result Status Action Handler import (#972)
- [Design] UI: Display message instead of empty body on Recorded / Check Responses (#963)
- [Runtime] JMeter: add missing Http Status Codes (#961)
- [Design] UI: Cookies from Chrome have no capital (#960)
- [Analysis] UI: hide disabled actions in virtual user tree (#959)
- [Analysis] Active users curve takes too much time to load on large tests (#958)
- Upgrade various backend libraries (#957)
Bug Fixes
- [Providers] AWS: disable Hong-Kong and Bahrain by default (#991)
- [Design] JMX Import fails when concurrentPool is empty (#976)
- [Design] JMX Import: Do not import deactivated headers manager (#977)
- [Runtime] CSV not included in generated JMX when used in server hostname (#968)
- [Documentation] Enterprise-Edition architecture schema backend port is
8090
not80
(#987) - [Analysis] Active users curve may not load due to elasticsearch buckets limit of
10000
(#984) - [Design] UI: "URL Parameter" should be named "Query parameter" (#980)
- [Analysis] UI: delta table percentages computation is sometimes wrong (#983)
- [Design] UI: Constant variable name is mandatory (#979)
- [Design] JMX Import: do not sanitize multipart filename when it contains a variable (#973)
- [Design] JMX Import: LoopController forever boolean is not handled (#971)
- [Design] JMX Import: ResponseAssertion isAssumeSuccess is not handled (#969)
- [Design] JMX Import: Duplicate variables imported when description being set afterwards (#965)
- [Design] HAR Import: ignore resources loaded from Chrome / Firefox Cache (#962)
- [Design] UI: Request and Response search preset return no results (#955)
- [Analysis] UI: switching from hits to containers is not taken into account (#956)
11.0.1 (10th July 2019)¶
Docker Images
octoperf/docker-agent:11.0.0
octoperf/enterprise-edition:11.0.1
octoperf/enterprise-ui:11.0.1
octoperf/enterprise-documentation:11.0.1
docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
octoperf/jmeter-standard:11.0.0
octoperf/jmeter-webdriver:11.0.0
Enhancements
- UI: improve drag'n drop when editing a virtual user script (#950)
- Enterprise: Helm Chart to install on Kubernetes (#947)
- UI: configurable custom description on login page (#948)
- UI: upgrade to AngularJS
1.7
(#949)
Bug Fixes
- Kubernetes: gracefully shutdown backend by trapping TERM signal (#952)
- UI: fix invalid label in area chart (#953)
- Elasticsearch: wait until database is started before booting backend (#945)
- UI: Hide edition widget when exporting report (#942)
- Runtime: generated JTL has wrong labels (#944)
- UI: increase sampling delta on analysis report (#943)
- UI: replace WYSIWYG HTML editors by Markdown editors (#954)
11.0.0 (14th June 2019)¶
IMPORTANT: carefully follow our 10.6.x to 11.x.x migration guide before upgrading. OctoPerf 11.0.x
uses Elasticsearch 7.1.1.
Docker Images
octoperf/docker-agent:11.0.0
octoperf/enterprise-edition:11.0.0
octoperf/enterprise-ui:11.0.0
octoperf/enterprise-documentation:11.0.0
docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
octoperf/jmeter-standard:11.0.0
octoperf/jmeter-webdriver:11.0.0
Enhancements
- Docker Images: upgrade to Java JDK 11.0.3
- Upgrade Elasticsearch from
6.8.0
to7.1.1
(#933) - Elasticsearch: use Rest High Level Client instead of Transport Client (#933)
- Upgrad internal libraries to latest minor version (#937)
- Upgrade Hazelcast to
3.11.4
(#931) - Saas: enable Google social login (#939)
Bug Fixes
- SLA: Threshold may generate more alerts than necessary (#940)
- UI: Runtime regions globe has display issues on Firefox (#936)
- UI: report area chart is not displaying errors correctly (#935)
- UI: results tree doesn't work when request name contains HTML (#934)
- Elasticsearch: properly clear scroll when finished (#938)
10.6.1 (5th June 2019)¶
Docker Images
octoperf/docker-agent:10.6.0
octoperf/enterprise-edition:10.6.1
octoperf/enterprise-ui:10.6.1
octoperf/enterprise-documentation:10.6.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.8.0
octoperf/jmeter-standard:10.6.1
octoperf/jmeter-webdriver:10.6.1
Bug Fixes
- Agent: Load Generator monitoring may fail when using large csv datasets (#929)
- Runtime: fix race condition between host deactivation and PREPARING tests possibly using them (#926)
- Runtime: Properly terminate containers in case an error occurs while starting the test (#925)
10.6.0 (23th May 2019)¶
Major changes:
- Elasticsearch: upgrade from
6.5.4
to6.8.0
, - Cloud Providers: support Microsoft Azure cloud provider,
- Single Sign-On: support Oauth2 / OpenID Connect authentication.
Docker Images
octoperf/docker-agent:10.6.0
octoperf/enterprise-edition:10.6.0
octoperf/enterprise-ui:10.6.0
octoperf/enterprise-documentation:10.6.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.8.0
octoperf/jmeter-standard:10.5.1
octoperf/jmeter-webdriver:10.5.1
Enhancements
- Elasticsearch: upgrade from
6.5.4
to6.8.0
(#899) - Runtime: Support Microsoft Azure Cloud Provider (#858)
- User Management: Support Oauth2 / OIDC authentication (#904)
- Docker Agent: improve resiliency by implementing retries and circuit breakers when communicating with backend (#917)
- Runtime: easily disable non working monitoring connections while launching a test (#645)
- User Management: properties to enable / disable user registration, password-recovery and explicit login (#907)
- Runtime: Purge validation requests / responses every night (#914)
- Analysis: add area chart to default report (#910)
- Elasticsearch: configurable number of shards / replicas per indice (#912)
- Upgrade various dependencies to latest version (#909)
- Analysis: lower errors storage to 2 per request / 100 per instance by default (#903)
Bug Fixes
- Runtime: test stuck in INITIALIZING phase due to invalid DNS settings (#922)
- Validation: number of pass/fail in virtual user tree is incorrectly computed (#915)
- Runtime: log rebooting cloud instances as WARN instead of ERROR (#918)
- Runtime: escape double quotes in scenario name (#894)
- Analysis: remove legacy PERFMON sample type (#913)
- Analysis: Can't add same metric twice in summary item (#891)
- Maven Plugin scenario not deserialized correctly (#897)
10.5.1 (11th April 2019)¶
Docker Images
octoperf/docker-agent:10.5.0
octoperf/enterprise-edition:10.5.1
octoperf/enterprise-ui:10.5.1
octoperf/enterprise-documentation:10.5.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
octoperf/jmeter-standard:10.5.1
octoperf/jmeter-webdriver:10.5.1
Bug Fixes
- Runtime: JMeter Container execution fails when scenarioId ends with "-" (#889)
10.5.0 (4th April 2019)¶
Docker Images
octoperf/docker-agent:10.5.0
octoperf/enterprise-edition:10.5.0
octoperf/enterprise-ui:10.5.0
octoperf/enterprise-documentation:10.5.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
octoperf/jmeter-standard:10.5.0
octoperf/jmeter-webdriver:10.5.0
Bug Fixes
- Runtime: properly handle partial failure during PREPARING state (#882)
- JMeter: Mark requests as error during validation when an exception happens (#872)
- JMeter JTL: add AssertionFailureMessage in default config (#870)
- Design: mark query / post param as encoded if name must be encoded (#883)
Enhancements
- VU Validation: show request as error / failed if an assertion fails (#873)
- Design: Improve static resources filtering (#886)
- Analysis: show on each error if assertion failed in errors table (#887)
- Agent: periodically cleanup octoperf containers stuck in Created / Exited state (#885)
- Agent: can be used even when
docker.sock
volume is not mapped (#880) - Assertions: support all possible JMeter configurations (#877)
- Monitoring: Support Prometheus Gauge (#879)
- Agent: auto-upgrade can be disabled with
-e octoperf.auto-update=false
(#881) - Monitoring: JDBC driver
Class.forName
no longer required (#876) - Disable URL Blacklist when import JMX / HAR (#871)
- Monitoring: LG
% CPU Usage
(100 - % CPU Idle) (#868)
10.4.0 (19th March 2019)¶
Docker Images
octoperf/docker-agent:10.3.0
octoperf/enterprise-edition:10.4.0
octoperf/enterprise-ui:10.4.0
octoperf/enterprise-documentation:10.4.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
octoperf/jmeter-standard:10.4.0
octoperf/jmeter-webdriver:10.4.0
Bug Fixes
- LG Monitoring: Use % CPU User instead of % CPU Idle (#864)
- Check VU: fix edge case preventing check vu to be stopped (#862)
- LDAP: Ability to disable PartialResultException (#860)
- JMX: Import Regexp Extractor with non-default scope as generic (#859)
- JMX: Import Regexp Extractor as Generic if not recognized (#855)
- Agents: improve communication reliability (#857)
Enhancements
- Upgrade to JMeter 5.1.1 (#866)
- Error Details: Improve algorithm selecting which error details are kept (#865)
- Analysis: Pie chart metrics now available as stacked chart too (#854)
- UI: configurable admin email (when trying to delete a workspace) (#848)
- Improve Rest API Creation Wizard (#839)
- UI: Switch to D3.js for userload chart (#819)
- JSR Pre/Post Processors can be dropped anywhere (#813)
- Response Assertions: wider support (#813)
- UI: Ability to Clean Empty Servers (#596)
10.3.0 (5th March 2019)¶
Docker Images
octoperf/docker-agent:10.3.0
octoperf/enterprise-edition:10.3.0
octoperf/enterprise-ui:10.3.0
octoperf/enterprise-documentation:10.3.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
octoperf/jmeter-standard:10.3.0
octoperf/jmeter-webdriver:10.3.0
Bug Fixes
- Agent: ignore
NotModifiedException
on start / stop / remove container (#853) - Agent: start container task must be idempotent, ignoring (#850)
- CSV Files: Check variable usage in
JMeterAction
properties (#847)
Enhancements
- Internal Dependencies upgrades (#852)
- JMeter: upgrade to JMeter
5.1
(#851) - Elasticsearch Snapshots: support coma separated list of repositories (#846)
10.2.0 (25th February 2019)¶
Docker Images
octoperf/docker-agent:10.1.0
octoperf/enterprise-edition:10.2.0
octoperf/enterprise-ui:10.2.0
octoperf/enterprise-documentation:10.2.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
octoperf/jmeter-standard:10.1.0
octoperf/jmeter-webdriver:10.1.0
Bug Fixes
- AWS Provider: Cannot configure AWS provider because describeImages fails (#833)
- Bench Logs: in rare cases, an agent not being used may be logged (#834)
- POST request with single File weren't properly imported from JMeter (#838)
- Jenkins Plugin: Report URL link is not working (#840)
- JMeter JMX Export: do not export empty query parameters (#841)
Enhancements
- OctoPerf Maven Plugin: run your versioned JMX scripts directly from your favorite Continuous Integration server (#726)
- Upgrade to Elasticsearch
6.5.4
(#826) - LG Monitoring: remove
% CPU User
counter as% CPU Idle
is enough (#842)
10.1.1 (7th February 2019)¶
Docker Images
octoperf/docker-agent:10.1.0
octoperf/enterprise-edition:10.1.1
octoperf/enterprise-ui:10.1.1
octoperf/enterprise-documentation:10.1.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:10.1.0
octoperf/jmeter-webdriver:10.1.0
Bug Fixes
- Support expressions like
${__P(key,defaultValue)}
in constant throughput thinktime (#828) - UI: add
Apply All
button to Runtime Properties (#827) - Report Templates: further filter specific report items / metrics which cannot be fitted into a template (#825)
10.1.0 (5th February 2019)¶
OctoPerf 10.1 introduces the following major improvements:
- Docker Private Registries: the backend can be configured to use a private registry to pull jmeter images,
- Remote Control: Define JMeter properties and remotely change those properties live while the test is running,
- Report Templates: create your own report templates!
Other changes are listed below.
Docker Images
octoperf/docker-agent:10.1.0
octoperf/enterprise-edition:10.1.0
octoperf/enterprise-ui:10.1.0
octoperf/enterprise-documentation:10.1.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:10.1.0
octoperf/jmeter-webdriver:10.1.0
Bug Fixes
- Agent: upgrade may fail because containers list is not filtered properly (#824)
- Correlation Rules: Avoid duplicates when importing a framework several times (#823)
- Correlation Rules:
.NET
rules with overriden encoding are not working properly (#822)
Enhancements
- Docker: ability to configure a private Docker Registry (#820)
- Runtime: Remote Control JMeter Properties (#818)
- APM: Improve Instana Integration (#817)
- Remove Social Login from Saas platform (#816)
- Runtime: compute containers to run asynchronously (#814)
- Analysis: Automatically merge JTL files into a single file (#798)
- Analysis Report Templates (#474)
10.0.1 (29th January 2019)¶
This version fixes a regression which has been introduced in 10.0.0
.
Docker Images
octoperf/docker-agent:10.0.0
octoperf/enterprise-edition:10.0.1
octoperf/enterprise-ui:10.0.1
octoperf/enterprise-documentation:10.0.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:10.0.1
octoperf/jmeter-webdriver:10.0.1
Bug Fixes
- JMeter: CSV Splitter and Rendez-vous agents are not working (#812)
10.0.0 (28th January 2019)¶
OctoPerf 10 features the following major improvements:
- Upgrade from JDK 8 to Java JDK 11,
- Security: Backend, Agent and JMeter containers now running as non-privileged
octoperf
user, - Monitoring: New-Relic APM is now supported,
- APM: Instana is now supported,
- Server Port: both internal and public port can now be configured.
Warning
OctoPerf EE 10.0.0 introduces breaking changes. make sure to read the Migration guide to upgrade from previous versions.
Docker Images
octoperf/docker-agent:10.0.0
octoperf/enterprise-edition:10.0.0
octoperf/enterprise-ui:10.0.0
octoperf/enterprise-documentation:10.0.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:10.0.0
octoperf/jmeter-webdriver:10.0.0
Bug Fixes
- UI: Tree view displays invalid containers (#787)
Enhancements
- Cloud: add support for AWS
eu-north-1
region (Stockholm) (#795) - APM: add support for Instana (#809)
- JMeter: run as non-privileged
octoperf
user (#808) - Upgrade codebase from Java JDK 8 to Java JDK 11 (#718)
- Agent: restrict internal SSH access to
octoperf
user (#805) - JMeter Docker Image: change
JMETER_DIR
toJMETER_HOME
(#806) - Agent:
--privileged
is not required anymore (#804) - Docker Images: Run as non-privileged user (#803)
- Monitoring: Add New-Relic APM monitoring (#799)
- Clustering: remove Apache Ignite driver (#802)
- Improve Correlation Rules algorithm (#801)
- Upgrade to Spring Boot 2.1.2.RELEASE (#786)
- JMeter: import RandomCSV DataSet as CSV with shuffled rows (#775)
- Upgrade various internal libraries (#796)
9.8.0 (8th January 2019)¶
Docker Images
octoperf/docker-agent:9.8.0
octoperf/enterprise-edition:9.8.0
octoperf/enterprise-ui:9.8.0
octoperf/enterprise-documentation:9.8.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.8.0
octoperf/jmeter-webdriver:9.8.0
Bug Fixes
- UI: Entity tables sort on name / description is not refreshed (#793)
- Force content as
UTF-8
in http requests (#792) - Retrying scaling a test 1x time if waiting for machines for too long (#789)
- Make Agent communication fail-safe with retries on failure (#788)
- JMeter JMX: Import causes an NPE (#785)
- UI: Unpin Button is not working properly (#784)
- Agent: Upgrade can be stuck if multiple agents are running on the same machine (#782)
Enhancements
- Support
before-test.sh
andafter-test.sh
scripts before / after JMeter test run (#794)
9.7.0 (29th November 2018)¶
Docker Images
octoperf/docker-agent:9.7.0
octoperf/enterprise-edition:9.7.0
octoperf/enterprise-ui:9.7.0
octoperf/enterprise-documentation:9.7.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.5.0
octoperf/jmeter-webdriver:9.5.0
Bug Fixes
- Agent:
AgentFailure
message incorrectly mapped toAgentMessage
(#778) - UI: Editing a delay doesn't work (#779)
- WebDriver: add delay on import to avoid slamming the CPU (#605)
- Top Throughput: exclude
per second
metrics (#771) - Parallel Sampler: automatically switch
PARENT_SAMPLE
tofalse
on import (#764) - JMX Import: exclude Perfmon collector (#753)
- Results Tree display issues (#754)
- Agent: Timeout while pulling image (#773)
Enhancements
- Clustering: new
ignite
driver using Apache Ignite (#776) - Report Exports: customizable logo and company name (#621)
- Reports Export: Configurable number of lines in tables (#622)
- Reports Export: landscape mode (#624)
- Hazelcast: Upgrade from
3.10.6
to3.11
(#774) - Agent monitoring: add CPU Idle counter (#772)
- Saas: add twitter feed to login page (#769)
9.6.1 (20th November 2018)¶
Docker Images
octoperf/docker-agent:9.5.0
octoperf/enterprise-edition:9.6.1
octoperf/enterprise-ui:9.6.1
octoperf/enterprise-documentation:9.6.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.5.0
octoperf/jmeter-webdriver:9.5.0
Bug Fixes
- Test may fail to stop properly: JMeter lacks UDP max port (#768)
- Packer Manifest: properly parse DigitalOcean manifest when copying images during build (#767)
- JMX Import: when path is a variable, do not add leading slash (#762)
- VU Deletion: also delete check requests and responses (#681)
9.6.0 (19th November 2018)¶
Docker Images
octoperf/docker-agent:9.5.0
octoperf/enterprise-edition:9.6.0
octoperf/enterprise-ui:9.6.0
octoperf/enterprise-documentation:9.6.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.5.0
octoperf/jmeter-webdriver:9.5.0
Enhancements
- Runtime: add Cookie Policies
NETSCAPE
andBESTMATCH
policies (#765) - Analysis: add filters to Result and Error Tables (#763)
- Design: add Download Resources filter and pool size configuration (#273)
9.5.0 (9th November 2018)¶
Docker Images
octoperf/docker-agent:9.5.0
octoperf/enterprise-edition:9.5.0
octoperf/enterprise-ui:9.5.0
octoperf/enterprise-documentation:9.5.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.5.0
octoperf/jmeter-webdriver:9.5.0
Bug Fixes
- Agent upgrade may fail when container not found (#755)
Enhancements
- IP Spoofing: use multiple network interfaces / IPs to inject load (#760)
- UI: Reorganize Top Menu (#738)
- Elasticsearch 6.4.3 (#761)
9.4.2 (25th October 2018)¶
Docker Images
octoperf/docker-agent:9.4.2
octoperf/enterprise-edition:9.4.2
octoperf/enterprise-ui:9.4.2
octoperf/enterprise-documentation:9.4.2
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
octoperf/jmeter-standard:9.4.2
octoperf/jmeter-webdriver:9.4.2
Bug Fixes
- Enterprise-edition: password reset template mail is pointing to saas platform (#752)
- Multipart parameters with Filename as variable (
${var}
) not handled properly (#692)
Enhancements
- Proxy Settings:
docker-agent
now takes into account system proxy env variables (#750)
9.4.1 (17th October 2018)¶
Docker Images
octoperf/docker-agent:9.2.2
octoperf/enterprise-edition:9.4.1
octoperf/enterprise-ui:9.4.1
octoperf/enterprise-documentation:9.4.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
octoperf/jmeter-standard:9.4.0
octoperf/jmeter-webdriver:9.4.0
Bug Fixes
- HTTP 403 Access Denied when creating a workspace (#745)
- When using Medium instances on private AWS account, machine has not enough memory (#740)
- CSV files imported along with JMX are not properly linked to variables (#739)
- AppDynamics Header path is in reverse order (#748)
Enhancements
- Elasticsearch
6.4.2
(#747) - UI: Display JSR223 script action args (#744)
- UI: Comparison Results list not displaying one report (#742)
- Mail: support much wider possible configurations (#690)
9.4.0 (25th September 2018)¶
Docker Images
octoperf/docker-agent:9.2.2
octoperf/enterprise-edition:9.4.0
octoperf/enterprise-ui:9.4.0
octoperf/enterprise-documentation:9.4.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.1
octoperf/jmeter-standard:9.4.0
octoperf/jmeter-webdriver:9.4.0
Bug Fixes
- UserLogin event must be only sent when login is successful (#736)
- Results Tree is not working properly with WebDriver virtual users (#733)
Enhancements
- Upgrade many internal libraries to latest version (#731)
- Upgrade to JMeter 5 (#730)
- Sanity Check: warn when Host header is different from server hostname (#700)
- Sanity Check: warn if a CSV file is empty or has no values (#478)
- Sanity Check: warn if think times are high (greater than 30sec) (#391)
- Refactor Virtual User creation wizard (#735)
9.3.0 (17th September 2018)¶
Docker Images
octoperf/docker-agent:9.2.2
octoperf/enterprise-edition:9.3.0
octoperf/enterprise-ui:9.3.0
octoperf/enterprise-documentation:9.3.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
octoperf/jmeter-standard:9.2.2
octoperf/jmeter-webdriver:9.2.2
Bug Fixes
- Results Sampling: increase sampling when load significantly increases (>=100k vus) (#725)
- Docker Batches: cleanup batches stuck in
CREATED
state (#722) - Heavy Load Tests: Improve responsiveness and ingestion capacity (#721)
- UI: Runtime profile bug when adding point on crowded profile (#720)
- UI: Order Results table by increasing timestamp with millisecond precision (#714)
- JMX Import:
LoopController.loops
can be bothstringProp
andintProp
(#711) - UI: prevent switching from post body url-encoded to raw (#585)
Enhancements
- UI: Start OctoPerf on VU creation page (#724)
- CSVs: split CSV files only when enough values available (#719)
- Bench Errors: store 100 errors per container (previously 50) (#713)
- UI: inform user what's going to be deleted when deleting a workspace / project (#712)
- WebDriver: Use Google Chrome 68 instead of Firefox 47 (#710)
- Design: Support Http Request Names (#709)
- Log Agent IPs on test launch (#708)
- Reports: New Tree Table Report (#706)
9.2.2 (28th August 2018)¶
When upgrading to 9.2.2+
, you will need to upgrade your on-premise agents to the latest version manually. Simply delete and re-create the container using the command-line provided from the UI.
Docker Images
octoperf/docker-agent:9.2.2
octoperf/enterprise-edition:9.2.2
octoperf/enterprise-ui:9.2.2
octoperf/enterprise-documentation:9.2.2
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
octoperf/jmeter-standard:9.2.2
octoperf/jmeter-webdriver:9.2.2
Bug Fixes
- Agent Upgrade is failing due to improperly mapped volumes (#704)
- Load Generator network monitoring stats are not working (#701)
Enhancements
- Add support for a
remove-files.txt
file to delete files from JMeter (#703)
9.2.1 (9th August 2018)¶
Docker Images
octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.2.1
octoperf/enterprise-ui:9.2.1
octoperf/enterprise-documentation:9.2.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
octoperf/jmeter-standard:9.2.1
octoperf/jmeter-webdriver:9.2.1
Bug Fixes
- Unreachable Hosts should be rebooted after a cooldown period (#696)
- No m5.xlarge available in
ap-southeast-1
(#694) - Elasticsearch automated snapshots fails to delete old ones (#693)
- UI: wrong units displayed in graphs (#684)
- WebDriver: variables not detected when used in script parameters (#683)
- JMX Import: ignore WebDriver configurations (#682)
Enhancements
- JMeter Images: upgrade to Ubuntu 18.04LTS (#698)
- Performance: reduce number of http samples being sent (#697)
- Elasticsearch: automated snapshots through yml configuration (#687)
9.2.0 (12th July 2018)¶
Docker Images
octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.2.0
octoperf/enterprise-ui:9.2.0
octoperf/enterprise-documentation:9.2.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.1
octoperf/jmeter-standard:9.0.1
octoperf/jmeter-webdriver:9.0.1
Bug Fixes
- CSV variables used in WebDriver parameters aren't exported in JMX (#680)
- CSV variables used in WebDriver scripts aren't exported in JMX (#679)
- files named with Uppercase chars could not be found during test (#674)
- JMX Import: Scripts at test plan level are not imported (#663)
Enhancements
- Upgrade to Elasticsearch
6.3.1
(#678) - Add support for WebDriver parameters field (#675)
- Virtual user validation is updating live during the run (#672)
- Increase maximum settable memory by profile to
128MB
(#667) - AWS Provider: ability to configure memory, shutdown policy and cloud instances (#666)
- Cloud Providers: change zones from map to list to better support AWS Accounts with lots of VPCs (#662)
9.1.0 (2nd July 2018)¶
Docker Images
octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.1.0
octoperf/enterprise-ui:9.1.0
octoperf/enterprise-documentation:9.1.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.0
octoperf/jmeter-standard:9.0.1
octoperf/jmeter-webdriver:9.0.1
Bug Fixes
- Only Private docker providers can be created (#657)
- Fix licences panel in UI (#654)
- Properly import JMX when Authentication Manager is empty (#651)
Enhancements
- Improve Guided Tour (#653)
- Automatically detect and downloading JMeter Plugins when importing JMX (#652)
- Upgrade various internal libraries (#647 and #648)
- Upgrade to Elasticsearch 6.3.0 (#644)
- Cloud Providers: Support AWS Elastic IPs and DigitalOcean Floating IPs (#635)
9.0.1 (18th June 2018)¶
Docker Images
octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.0.1
octoperf/enterprise-ui:9.0.1
octoperf/enterprise-documentation:9.0.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
octoperf/jmeter-standard:9.0.1
octoperf/jmeter-webdriver:9.0.1
Bug Fixes
- JMX: Server is imported as https with port 80 (#646)
ServerAgentService.isIdle
should ignore Exited containers (#643)- Stale Tests are not finished after xx minutes (#642)
- Windows process monitor 404 (#639)
- JMX Import Issue with Test Fragments (#633)
- Do not import headers starting with
:
(#630) - JMeter script tries to send agent logs (#629)
- Disabled Agent Seen as Down (#628)
- Agent Randomly appears as disconnected when high-availability is enabled (#627)
Enhancements
- Upgrade various external libraries (#641)
- Improve Test Initialization logs (#632)
9.0.0 (1st June 2018)¶
Major change: As of 9.0.0 and above, Rancher is not used for load generators anymore.
Docker Images
octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.0.0
octoperf/enterprise-ui:9.0.0
octoperf/enterprise-documentation:9.0.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
octoperf/jmeter-standard:9.0.0
octoperf/jmeter-webdriver:9.0.0
Bug Fixes
- Importing Firefox 60 and above HAR could fail (#614)
- JMX Import was not properly importing timers (#619)
- Increase Extra Memory Percent to improve small machines usage (#620)
Enhancements
- Rancher is no longer required to run OctoPerf EE (#609)
- Scenario and Results views feature a World Map
8.3.0 (19th April 2018)¶
Bug Fixes
- Upgrade to Spring Boot 2, Elasticsearch 6.2.3 and other various libraries (#586)
- Parse
${__P(name,value)}
variable on JMX import (#601) - CSV File splitting is not working properly when column names inside as first line (#603)
8.2.0 (26th March 2018)¶
Enhancements
- Design: Correlation rules frameworks update (#590)
- Design: Virtual user validation now display 4XX+ on record as errors (#270)
- Design: Copy/ paste refactor (#558)
- Design: Autocompletion in server configuration (#562)
- Design: Pin Validate Virtual User panel if one is running when opening a VU (#570)
- Design: Sanity Check displays an error on query parameter with empty name and value (#550)
- Monitoring: Support Prometheus monitoring (#500)
- Runtime: Reduce default memory used by JMeter to download large files (#581)
- Runtime: Custom load policy (#556 and #587)
- Analysis: Add 99 percentile to result table (#566)
- UI: Documentation lazy loading (#557)
- UI: Update fontawesome to latest version (#547)
Bug Fixes
- JMX Import: Regexp Extractor with body unescaped should be imported as extractor on body (#580)
- Design: PUT request contains invalid chars in body (#582)
- Design: Selenium webdriver request tab not showing the URL accessed (#574)
- Design: PUT request body must be raw (Name/Value post parameters are ignored by JMeter in PUT / PATCH requests) (#573)
- Design: Https Server Port is 80 instead of 443 on JMX Import (#560)
- Design: Search and replace hangs (#565)
- Runtime: URL Parameter not encoded at replay by JMeter (#569)
- Runtime: M5.xlarge not available in all zones (#555)
- Runtime: JMX: If Controller is not properly configured (#561)
- Runtime: ThinktimeText is causing issues in JMX with DelayAction (#559)
- Analysis: Sent bytes always shows 0 in summary with containers (#567)
- Analysis: Result table sort on numeric values (#564)
8.1.0 (15th February 2018)¶
Enhancements
- Upgrade from Elasticsearch 6.1.2 to 6.2.1 (#545)
- Upgrade various internal libraries (#545 bis)
- Support variables in Thinktimes (#544)
- Upgrade from JMeter 3.3 to 4.0 (#546)
- Support JMeter LoopController (#526)
- UI: Improve Scenario Profile Edition (#539)
- UI: Automatically pin buttons when searching / running a validation (#537)
- UI: Improve test start time visibility (#532)
- UI: Replace Toaster warning messages by notifications (#531)
- UI: Update various dependencies (#531)
- UI: Allow child actions for JMeterAction (#527)
- UI: Improve Printable Test Report (#530)
- UI: Improve Results Trend Chart (#522)
Bug Fixes
- JMX Import: support HTTP Request Defaults with no port or scheme (#549)
- Fix: Post Parameters with only name have equals included (#543)
- JMX Import: Fix edge cases (#542)
- UI: Autosave may not kick in on page change (#535)
- UI: Fix a scrolling issue when viewing test reports (#528)
- Fix a possible NPE when importing HAR from latest Chrome version (#523)
8.0.1 (4th February 2018)¶
Enhancements
- UI: Confirm dialog before stopping the test (#513)
- UI: In monitoring, skip resources panel when none required by the monitor (#485)
Bug Fixes
- JMX Import: support JMX generated by third party tools like Taurus (#521)
- UI: Report summary has no scrollbar (#520)
- UI: Clear BenchInformationResource cache (#518)
- JMX Import: properly handle http request defaults port (#515)
- UI: Various small cosmetic issues (#514)
8.0.0 (12th January 2018)¶
Warning
Please carefully follow 7.5.x to 8.0.x Migration guide prior to upgrading to 8.0.x.
Enhancements
- Comparison: compare results across several test results
- Upgrade to Elasticsearch 6.1.1
7.5.2 (19th December 2017)¶
Bug Fixes
- Latest Chrome Browser HARs are imported in reversed chronological order (#499)
7.5.1 (6th December 2017)¶
Bug Fixes
- Plain Post Data Encoding in exported JMX is invalid in some cases (#492)
- Analysis Results Table column order is randomly changing (#486)
7.5.0 (28th November 2017)¶
Enhancements
- Single Sign-On (SSO): LDAP authentication (#351)
- Backend supports Startup Delay support in UserLoad in Scenarios (#477)
Bug Fixes
- JMeter JMX with WebDriver is not marked as WebDriver (#488)
7.4.1 (23th November 2017)¶
Bug Fixes
- Raw Post Body containing CRLF must be encoded properly in JMX (#483)
- CSV Variable Balancing may not work properly in some edge cases (#481)
- Http Server Authentication did not support absolute URLs (#480)
- User login must be case-insensitive (#467)
7.4.0 (17th November 2017)¶
Enhancements
- OctoPerf SLA : Service Level Agreement profiles are configurable in the Design / Monitoring and visible in the test reports.
- Load Injector monitoring : added threshold alarms when CPU usage is over 80%.
- HTTP Servers : Connection and Response Timeouts are now configurable per server.
- Correlation Rules Frameworks : updated the SAML and .Net frameworks.
- Virtual User Cleanup : when removing SLA profiles or HTTP Servers, empty containers are also removed.
- Report Trends : the analysis page show a trend graph if showing the response time and hits/errors counts for all selected reports.
- Frontend optimization : the design page and the search & replace for big Virtual Users (hundreds of actions) is now faster.
- HTTP headers auto-completion : common HTTP request actions header names are now suggested during edition.
- Test report summary : to quickly navigate in the report, a summary is displayed on the right.
- ElasticSearch upgrade to version 5.6.4.
Bug Fixes
- [Design] Correlation rules injections 'with name' field is left to an empty string when it is cleared.
- [Design] The displayed number of items currently in the trash is wrong after an action is dropped back into the Virtual User.
- [Design] JMX import may throw a ClassCastException.
7.3.4 (21th October 2017)¶
Bug Fixes
- [Design] HTTP Query Parameters with only name aren't within the JMX Script
7.3.3 (20th October 2017)¶
Bug Fixes
- [Monitoring] HTTP 400 Bad Request when listing Monitoring Agents
7.3.2 (19th October 2017)¶
Enhancements
- OctoPerf Catalog: configurable data volume mapping
Bug Fixes
- [Design] HAR Import: ignore query params with empty name and value bug design
- [Design] Bulk server deletion make encounter race condition
- [Design] Create Default Correlation Frameworks if none found
7.3.1 (18th October 2017)¶
Bug Fixes
- Jenkins JUnit Report were broken
- Monitoring fails with Http 503 error with restricted workspace rights
- Query parameters are always written in Path (JMeter JMX)
- HAR import: query parameters with only value are treated as name only
- Jenkins: Report link points to Saas when using Enterprise-Edition