Release Notes¶

9.7.0 (29th November 2018)¶

Docker Images

octoperf/docker-agent:9.7.0
octoperf/enterprise-edition:9.7.0
octoperf/enterprise-ui:9.7.0
octoperf/enterprise-documentation:9.7.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.5.0
octoperf/jmeter-webdriver:9.5.0

Bug Fixes

Agent: AgentFailure message incorrectly mapped to AgentMessage (#778)
UI: Editing a delay doesn't work (#779)
WebDriver: add delay on import to avoid slamming the CPU (#605)
Top Throughput: exclude per second metrics (#771)
Parallel Sampler: automatically switch PARENT_SAMPLE to false on import (#764)
JMX Import: exclude Perfmon collector (#753)
Results Tree display issues (#754)
Agent: Timeout while pulling image (#773)

Enhancements

Clustering: new ignite driver using Apache Ignite (#776)
Report Exports: customizable logo and company name (#621)
Reports Export: Configurable number of lines in tables (#622)
Reports Export: landscape mode (#624)
Hazelcast: Upgrade from 3.10.6 to 3.11 (#774)
Agent monitoring: add CPU Idle counter (#772)
Saas: add twitter feed to login page (#769)

9.6.1 (20th November 2018)¶

Docker Images

octoperf/docker-agent:9.5.0
octoperf/enterprise-edition:9.6.1
octoperf/enterprise-ui:9.6.1
octoperf/enterprise-documentation:9.6.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.5.0
octoperf/jmeter-webdriver:9.5.0

Bug Fixes

Test may fail to stop properly: JMeter lacks UDP max port (#768)
Packer Manifest: properly parse DigitalOcean manifest when copying images during build (#767)
JMX Import: when path is a variable, do not add leading slash (#762)
VU Deletion: also delete check requests and responses (#681)

9.6.0 (19th November 2018)¶

Docker Images

octoperf/docker-agent:9.5.0
octoperf/enterprise-edition:9.6.0
octoperf/enterprise-ui:9.6.0
octoperf/enterprise-documentation:9.6.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.5.0
octoperf/jmeter-webdriver:9.5.0

Enhancements

Runtime: add Cookie Policies NETSCAPE and BESTMATCH policies (#765)
Analysis: add filters to Result and Error Tables (#763)
Design: add Download Resources filter and pool size configuration (#273)

9.5.0 (9th November 2018)¶

Docker Images

octoperf/docker-agent:9.5.0
octoperf/enterprise-edition:9.5.0
octoperf/enterprise-ui:9.5.0
octoperf/enterprise-documentation:9.5.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
octoperf/jmeter-standard:9.5.0
octoperf/jmeter-webdriver:9.5.0

Bug Fixes

Agent upgrade may fail when container not found (#755)

Enhancements

IP Spoofing: use multiple network interfaces / IPs to inject load (#760)
UI: Reorganize Top Menu (#738)
Elasticsearch 6.4.3 (#761)

9.4.2 (25th October 2018)¶

Docker Images

octoperf/docker-agent:9.4.2
octoperf/enterprise-edition:9.4.2
octoperf/enterprise-ui:9.4.2
octoperf/enterprise-documentation:9.4.2
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
octoperf/jmeter-standard:9.4.2
octoperf/jmeter-webdriver:9.4.2

Bug Fixes

Enterprise-edition: password reset template mail is pointing to saas platform (#752)
Multipart parameters with Filename as variable (${var}) not handled properly (#692)

Enhancements

Proxy Settings: docker-agent now takes into account system proxy env variables (#750)

9.4.1 (17th October 2018)¶

Docker Images

octoperf/docker-agent:9.2.2
octoperf/enterprise-edition:9.4.1
octoperf/enterprise-ui:9.4.1
octoperf/enterprise-documentation:9.4.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
octoperf/jmeter-standard:9.4.0
octoperf/jmeter-webdriver:9.4.0

Bug Fixes

HTTP 403 Access Denied when creating a workspace (#745)
When using Medium instances on private AWS account, machine has not enough memory (#740)
CSV files imported along with JMX are not properly linked to variables (#739)
AppDynamics Header path is in reverse order (#748)

Enhancements

Elasticsearch 6.4.2 (#747)
UI: Display JSR223 script action args (#744)
UI: Comparison Results list not displaying one report (#742)
Mail: support much wider possible configurations (#690)

9.4.0 (25th September 2018)¶

Docker Images

octoperf/docker-agent:9.2.2
octoperf/enterprise-edition:9.4.0
octoperf/enterprise-ui:9.4.0
octoperf/enterprise-documentation:9.4.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.1
octoperf/jmeter-standard:9.4.0
octoperf/jmeter-webdriver:9.4.0

Bug Fixes

UserLogin event must be only sent when login is successful (#736)
Results Tree is not working properly with WebDriver virtual users (#733)

Enhancements

Upgrade many internal libraries to latest version (#731)
Upgrade to JMeter 5 (#730)
Sanity Check: warn when Host header is different from server hostname (#700)
Sanity Check: warn if a CSV file is empty or has no values (#478)
Sanity Check: warn if think times are high (greater than 30sec) (#391)
Refactor Virtual User creation wizard (#735)

9.3.0 (17th September 2018)¶

Docker Images

octoperf/docker-agent:9.2.2
octoperf/enterprise-edition:9.3.0
octoperf/enterprise-ui:9.3.0
octoperf/enterprise-documentation:9.3.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
octoperf/jmeter-standard:9.2.2
octoperf/jmeter-webdriver:9.2.2

Bug Fixes

Results Sampling: increase sampling when load significantly increases (>=100k vus) (#725)
Docker Batches: cleanup batches stuck in CREATED state (#722)
Heavy Load Tests: Improve responsiveness and ingestion capacity (#721)
UI: Runtime profile bug when adding point on crowded profile (#720)
UI: Order Results table by increasing timestamp with millisecond precision (#714)
JMX Import: LoopController.loops can be both stringProp and intProp (#711)
UI: prevent switching from post body url-encoded to raw (#585)

Enhancements

UI: Start OctoPerf on VU creation page (#724)
CSVs: split CSV files only when enough values available (#719)
Bench Errors: store 100 errors per container (previously 50) (#713)
UI: inform user what's going to be deleted when deleting a workspace / project (#712)
WebDriver: Use Google Chrome 68 instead of Firefox 47 (#710)
Design: Support Http Request Names (#709)
Log Agent IPs on test launch (#708)
Reports: New Tree Table Report (#706)

9.2.2 (28th August 2018)¶

When upgrading to 9.2.2+, you will need to upgrade your on-premise agents to the latest version manually. Simply delete and re-create the container using the command-line provided from the UI.

Docker Images

octoperf/docker-agent:9.2.2
octoperf/enterprise-edition:9.2.2
octoperf/enterprise-ui:9.2.2
octoperf/enterprise-documentation:9.2.2
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
octoperf/jmeter-standard:9.2.2
octoperf/jmeter-webdriver:9.2.2

Bug Fixes

Agent Upgrade is failing due to improperly mapped volumes (#704)
Load Generator network monitoring stats are not working (#701)

Enhancements

Add support for a remove-files.txt file to delete files from JMeter (#703)

9.2.1 (9th August 2018)¶

Docker Images

octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.2.1
octoperf/enterprise-ui:9.2.1
octoperf/enterprise-documentation:9.2.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
octoperf/jmeter-standard:9.2.1
octoperf/jmeter-webdriver:9.2.1

Bug Fixes

Unreachable Hosts should be rebooted after a cooldown period (#696)
No m5.xlarge available in ap-southeast-1 (#694)
Elasticsearch automated snapshots fails to delete old ones (#693)
UI: wrong units displayed in graphs (#684)
WebDriver: variables not detected when used in script parameters (#683)
JMX Import: ignore WebDriver configurations (#682)

Enhancements

JMeter Images: upgrade to Ubuntu 18.04LTS (#698)
Performance: reduce number of http samples being sent (#697)
Elasticsearch: automated snapshots through yml configuration (#687)

9.2.0 (12th July 2018)¶

Docker Images

octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.2.0
octoperf/enterprise-ui:9.2.0
octoperf/enterprise-documentation:9.2.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.1
octoperf/jmeter-standard:9.0.1
octoperf/jmeter-webdriver:9.0.1

Bug Fixes

CSV variables used in WebDriver parameters aren't exported in JMX (#680)
CSV variables used in WebDriver scripts aren't exported in JMX (#679)
files named with Uppercase chars could not be found during test (#674)
JMX Import: Scripts at test plan level are not imported (#663)

Enhancements

Upgrade to Elasticsearch 6.3.1 (#678)
Add support for WebDriver parameters field (#675)
Virtual user validation is updating live during the run (#672)
Increase maximum settable memory by profile to 128MB (#667)
AWS Provider: ability to configure memory, shutdown policy and cloud instances (#666)
Cloud Providers: change zones from map to list to better support AWS Accounts with lots of VPCs (#662)

9.1.0 (2nd July 2018)¶

Docker Images

octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.1.0
octoperf/enterprise-ui:9.1.0
octoperf/enterprise-documentation:9.1.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.0
octoperf/jmeter-standard:9.0.1
octoperf/jmeter-webdriver:9.0.1

Bug Fixes

Only Private docker providers can be created (#657)
Fix licences panel in UI (#654)
Properly import JMX when Authentication Manager is empty (#651)

Enhancements

Improve Guided Tour (#653)
Automatically detect and downloading JMeter Plugins when importing JMX (#652)
Upgrade various internal libraries (#647 and #648)
Upgrade to Elasticsearch 6.3.0 (#644)
Cloud Providers: Support AWS Elastic IPs and DigitalOcean Floating IPs (#635)

9.0.1 (18th June 2018)¶

Docker Images

octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.0.1
octoperf/enterprise-ui:9.0.1
octoperf/enterprise-documentation:9.0.1
docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
octoperf/jmeter-standard:9.0.1
octoperf/jmeter-webdriver:9.0.1

Bug Fixes

JMX: Server is imported as https with port 80 (#646)
ServerAgentService.isIdle should ignore Exited containers (#643)
Stale Tests are not finished after xx minutes (#642)
Windows process monitor 404 (#639)
JMX Import Issue with Test Fragments (#633)
Do not import headers starting with : (#630)
JMeter script tries to send agent logs (#629)
Disabled Agent Seen as Down (#628)
Agent Randomly appears as disconnected when high-availability is enabled (#627)

Enhancements

Upgrade various external libraries (#641)
Improve Test Initialization logs (#632)

9.0.0 (1st June 2018)¶

Major change: As of 9.0.0 and above, Rancher is not used for load generators anymore.

Docker Images

octoperf/docker-agent:9.0.0
octoperf/enterprise-edition:9.0.0
octoperf/enterprise-ui:9.0.0
octoperf/enterprise-documentation:9.0.0
docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
octoperf/jmeter-standard:9.0.0
octoperf/jmeter-webdriver:9.0.0

Bug Fixes

Importing Firefox 60 and above HAR could fail (#614)
JMX Import was not properly importing timers (#619)
Increase Extra Memory Percent to improve small machines usage (#620)

Enhancements

Rancher is no longer required to run OctoPerf EE (#609)
Scenario and Results views feature a World Map

8.3.0 (19th April 2018)¶

Bug Fixes

Upgrade to Spring Boot 2, Elasticsearch 6.2.3 and other various libraries (#586)
Parse ${__P(name,value)} variable on JMX import (#601)
CSV File splitting is not working properly when column names inside as first line (#603)

8.2.0 (26th March 2018)¶

Enhancements

Design: Correlation rules frameworks update (#590)
Design: Virtual user validation now display 4XX+ on record as errors (#270)
Design: Copy/ paste refactor (#558)
Design: Autocompletion in server configuration (#562)
Design: Pin Validate Virtual User panel if one is running when opening a VU (#570)
Design: Sanity Check displays an error on query parameter with empty name and value (#550)
Monitoring: Support Prometheus monitoring (#500)
Runtime: Reduce default memory used by JMeter to download large files (#581)
Runtime: Custom load policy (#556 and #587)
Analysis: Add 99 percentile to result table (#566)
UI: Documentation lazy loading (#557)
UI: Update fontawesome to latest version (#547)

Bug Fixes

JMX Import: Regexp Extractor with body unescaped should be imported as extractor on body (#580)
Design: PUT request contains invalid chars in body (#582)
Design: Selenium webdriver request tab not showing the URL accessed (#574)
Design: PUT request body must be raw (Name/Value post parameters are ignored by JMeter in PUT / PATCH requests) (#573)
Design: Https Server Port is 80 instead of 443 on JMX Import (#560)
Design: Search and replace hangs (#565)
Runtime: URL Parameter not encoded at replay by JMeter (#569)
Runtime: M5.xlarge not available in all zones (#555)
Runtime: JMX: If Controller is not properly configured (#561)
Runtime: ThinktimeText is causing issues in JMX with DelayAction (#559)
Analysis: Sent bytes always shows 0 in summary with containers (#567)
Analysis: Result table sort on numeric values (#564)

8.1.0 (15th February 2018)¶

Enhancements

Upgrade from Elasticsearch 6.1.2 to 6.2.1 (#545)
Upgrade various internal libraries (#545 bis)
Support variables in Thinktimes (#544)
Upgrade from JMeter 3.3 to 4.0 (#546)
Support JMeter LoopController (#526)
UI: Improve Scenario Profile Edition (#539)
UI: Automatically pin buttons when searching / running a validation (#537)
UI: Improve test start time visibility (#532)
UI: Replace Toaster warning messages by notifications (#531)
UI: Update various dependencies (#531)
UI: Allow child actions for JMeterAction (#527)
UI: Improve Printable Test Report (#530)
UI: Improve Results Trend Chart (#522)

Bug Fixes

JMX Import: support HTTP Request Defaults with no port or scheme (#549)
Fix: Post Parameters with only name have equals included (#543)
JMX Import: Fix edge cases (#542)
UI: Autosave may not kick in on page change (#535)
UI: Fix a scrolling issue when viewing test reports (#528)
Fix a possible NPE when importing HAR from latest Chrome version (#523)

8.0.1 (4th February 2018)¶

Enhancements

UI: Confirm dialog before stopping the test (#513)
UI: In monitoring, skip resources panel when none required by the monitor (#485)

Bug Fixes

JMX Import: support JMX generated by third party tools like Taurus (#521)
UI: Report summary has no scrollbar (#520)
UI: Clear BenchInformationResource cache (#518)
JMX Import: properly handle http request defaults port (#515)
UI: Various small cosmetic issues (#514)

8.0.0 (12th January 2018)¶

Warning

Please carefully follow 7.5.x to 8.0.x Migration guide prior to upgrading to 8.0.x.

Enhancements

Comparison: compare results across several test results
Upgrade to Elasticsearch 6.1.1

7.5.2 (19th December 2017)¶

Bug Fixes

Latest Chrome Browser HARs are imported in reversed chronological order (#499)

7.5.1 (6th December 2017)¶

Bug Fixes

Plain Post Data Encoding in exported JMX is invalid in some cases (#492)
Analysis Results Table column order is randomly changing (#486)

7.5.0 (28th November 2017)¶

Enhancements

Single Sign-On (SSO): LDAP authentication (#351)
Backend supports Startup Delay support in UserLoad in Scenarios (#477)

Bug Fixes

JMeter JMX with WebDriver is not marked as WebDriver (#488)

7.4.1 (23th November 2017)¶

Bug Fixes

Raw Post Body containing CRLF must be encoded properly in JMX (#483)
CSV Variable Balancing may not work properly in some edge cases (#481)
Http Server Authentication did not support absolute URLs (#480)
User login must be case-insensitive (#467)

7.4.0 (17th November 2017)¶

Enhancements

OctoPerf SLA : Service Level Agreement profiles are configurable in the Design / Monitoring and visible in the test reports.
Load Injector monitoring : added threshold alarms when CPU usage is over 80%.
HTTP Servers : Connection and Response Timeouts are now configurable per server.
Correlation Rules Frameworks : updated the SAML and .Net frameworks.
Virtual User Cleanup : when removing SLA profiles or HTTP Servers, empty containers are also removed.
Report Trends : the analysis page show a trend graph if showing the response time and hits/errors counts for all selected reports.
Frontend optimization : the design page and the search & replace for big Virtual Users (hundreds of actions) is now faster.
HTTP headers auto-completion : common HTTP request actions header names are now suggested during edition.
Test report summary : to quickly navigate in the report, a summary is displayed on the right.
ElasticSearch upgrade to version 5.6.4.

Bug Fixes

[Design] Correlation rules injections 'with name' field is left to an empty string when it is cleared.
[Design] The displayed number of items currently in the trash is wrong after an action is dropped back into the Virtual User.
[Design] JMX import may throw a ClassCastException.

7.3.4 (21th October 2017)¶

Bug Fixes

[Design] HTTP Query Parameters with only name aren't within the JMX Script

7.3.3 (20th October 2017)¶

Bug Fixes

[Monitoring] HTTP 400 Bad Request when listing Monitoring Agents

7.3.2 (19th October 2017)¶

Enhancements

OctoPerf Catalog: configurable data volume mapping

Bug Fixes

[Design] HAR Import: ignore query params with empty name and value bug design
[Design] Bulk server deletion make encounter race condition
[Design] Create Default Correlation Frameworks if none found

7.3.1 (18th October 2017)¶

Bug Fixes

Jenkins JUnit Report were broken
Monitoring fails with Http 503 error with restricted workspace rights
Query parameters are always written in Path (JMeter JMX)
HAR import: query parameters with only value are treated as name only
Jenkins: Report link points to Saas when using Enterprise-Edition