Skip to content

Release Notes

9.7.0 (29th November 2018)

Docker Images

  • octoperf/docker-agent:9.7.0
  • octoperf/enterprise-edition:9.7.0
  • octoperf/enterprise-ui:9.7.0
  • octoperf/enterprise-documentation:9.7.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.5.0
  • octoperf/jmeter-webdriver:9.5.0

Bug Fixes

  • Agent: AgentFailure message incorrectly mapped to AgentMessage (#778)
  • UI: Editing a delay doesn't work (#779)
  • WebDriver: add delay on import to avoid slamming the CPU (#605)
  • Top Throughput: exclude per second metrics (#771)
  • Parallel Sampler: automatically switch PARENT_SAMPLE to false on import (#764)
  • JMX Import: exclude Perfmon collector (#753)
  • Results Tree display issues (#754)
  • Agent: Timeout while pulling image (#773)

Enhancements

  • Clustering: new ignite driver using Apache Ignite (#776)
  • Report Exports: customizable logo and company name (#621)
  • Reports Export: Configurable number of lines in tables (#622)
  • Reports Export: landscape mode (#624)
  • Hazelcast: Upgrade from 3.10.6 to 3.11 (#774)
  • Agent monitoring: add CPU Idle counter (#772)
  • Saas: add twitter feed to login page (#769)

9.6.1 (20th November 2018)

Docker Images

  • octoperf/docker-agent:9.5.0
  • octoperf/enterprise-edition:9.6.1
  • octoperf/enterprise-ui:9.6.1
  • octoperf/enterprise-documentation:9.6.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.5.0
  • octoperf/jmeter-webdriver:9.5.0

Bug Fixes

  • Test may fail to stop properly: JMeter lacks UDP max port (#768)
  • Packer Manifest: properly parse DigitalOcean manifest when copying images during build (#767)
  • JMX Import: when path is a variable, do not add leading slash (#762)
  • VU Deletion: also delete check requests and responses (#681)

9.6.0 (19th November 2018)

Docker Images

  • octoperf/docker-agent:9.5.0
  • octoperf/enterprise-edition:9.6.0
  • octoperf/enterprise-ui:9.6.0
  • octoperf/enterprise-documentation:9.6.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.5.0
  • octoperf/jmeter-webdriver:9.5.0

Enhancements

  • Runtime: add Cookie Policies NETSCAPE and BESTMATCH policies (#765)
  • Analysis: add filters to Result and Error Tables (#763)
  • Design: add Download Resources filter and pool size configuration (#273)

9.5.0 (9th November 2018)

Docker Images

  • octoperf/docker-agent:9.5.0
  • octoperf/enterprise-edition:9.5.0
  • octoperf/enterprise-ui:9.5.0
  • octoperf/enterprise-documentation:9.5.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.5.0
  • octoperf/jmeter-webdriver:9.5.0

Bug Fixes

  • Agent upgrade may fail when container not found (#755)

Enhancements

  • IP Spoofing: use multiple network interfaces / IPs to inject load (#760)
  • UI: Reorganize Top Menu (#738)
  • Elasticsearch 6.4.3 (#761)

9.4.2 (25th October 2018)

Docker Images

  • octoperf/docker-agent:9.4.2
  • octoperf/enterprise-edition:9.4.2
  • octoperf/enterprise-ui:9.4.2
  • octoperf/enterprise-documentation:9.4.2
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
  • octoperf/jmeter-standard:9.4.2
  • octoperf/jmeter-webdriver:9.4.2

Bug Fixes

  • Enterprise-edition: password reset template mail is pointing to saas platform (#752)
  • Multipart parameters with Filename as variable (${var}) not handled properly (#692)

Enhancements

  • Proxy Settings: docker-agent now takes into account system proxy env variables (#750)

9.4.1 (17th October 2018)

Docker Images

  • octoperf/docker-agent:9.2.2
  • octoperf/enterprise-edition:9.4.1
  • octoperf/enterprise-ui:9.4.1
  • octoperf/enterprise-documentation:9.4.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
  • octoperf/jmeter-standard:9.4.0
  • octoperf/jmeter-webdriver:9.4.0

Bug Fixes

  • HTTP 403 Access Denied when creating a workspace (#745)
  • When using Medium instances on private AWS account, machine has not enough memory (#740)
  • CSV files imported along with JMX are not properly linked to variables (#739)
  • AppDynamics Header path is in reverse order (#748)

Enhancements

  • Elasticsearch 6.4.2 (#747)
  • UI: Display JSR223 script action args (#744)
  • UI: Comparison Results list not displaying one report (#742)
  • Mail: support much wider possible configurations (#690)

9.4.0 (25th September 2018)

Docker Images

  • octoperf/docker-agent:9.2.2
  • octoperf/enterprise-edition:9.4.0
  • octoperf/enterprise-ui:9.4.0
  • octoperf/enterprise-documentation:9.4.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.1
  • octoperf/jmeter-standard:9.4.0
  • octoperf/jmeter-webdriver:9.4.0

Bug Fixes

  • UserLogin event must be only sent when login is successful (#736)
  • Results Tree is not working properly with WebDriver virtual users (#733)

Enhancements

  • Upgrade many internal libraries to latest version (#731)
  • Upgrade to JMeter 5 (#730)
  • Sanity Check: warn when Host header is different from server hostname (#700)
  • Sanity Check: warn if a CSV file is empty or has no values (#478)
  • Sanity Check: warn if think times are high (greater than 30sec) (#391)
  • Refactor Virtual User creation wizard (#735)

9.3.0 (17th September 2018)

Docker Images

  • octoperf/docker-agent:9.2.2
  • octoperf/enterprise-edition:9.3.0
  • octoperf/enterprise-ui:9.3.0
  • octoperf/enterprise-documentation:9.3.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
  • octoperf/jmeter-standard:9.2.2
  • octoperf/jmeter-webdriver:9.2.2

Bug Fixes

  • Results Sampling: increase sampling when load significantly increases (>=100k vus) (#725)
  • Docker Batches: cleanup batches stuck in CREATED state (#722)
  • Heavy Load Tests: Improve responsiveness and ingestion capacity (#721)
  • UI: Runtime profile bug when adding point on crowded profile (#720)
  • UI: Order Results table by increasing timestamp with millisecond precision (#714)
  • JMX Import: LoopController.loops can be both stringProp and intProp (#711)
  • UI: prevent switching from post body url-encoded to raw (#585)

Enhancements

  • UI: Start OctoPerf on VU creation page (#724)
  • CSVs: split CSV files only when enough values available (#719)
  • Bench Errors: store 100 errors per container (previously 50) (#713)
  • UI: inform user what's going to be deleted when deleting a workspace / project (#712)
  • WebDriver: Use Google Chrome 68 instead of Firefox 47 (#710)
  • Design: Support Http Request Names (#709)
  • Log Agent IPs on test launch (#708)
  • Reports: New Tree Table Report (#706)

9.2.2 (28th August 2018)

When upgrading to 9.2.2+, you will need to upgrade your on-premise agents to the latest version manually. Simply delete and re-create the container using the command-line provided from the UI.

Docker Images

  • octoperf/docker-agent:9.2.2
  • octoperf/enterprise-edition:9.2.2
  • octoperf/enterprise-ui:9.2.2
  • octoperf/enterprise-documentation:9.2.2
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
  • octoperf/jmeter-standard:9.2.2
  • octoperf/jmeter-webdriver:9.2.2

Bug Fixes

  • Agent Upgrade is failing due to improperly mapped volumes (#704)
  • Load Generator network monitoring stats are not working (#701)

Enhancements

  • Add support for a remove-files.txt file to delete files from JMeter (#703)

9.2.1 (9th August 2018)

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.2.1
  • octoperf/enterprise-ui:9.2.1
  • octoperf/enterprise-documentation:9.2.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
  • octoperf/jmeter-standard:9.2.1
  • octoperf/jmeter-webdriver:9.2.1

Bug Fixes

  • Unreachable Hosts should be rebooted after a cooldown period (#696)
  • No m5.xlarge available in ap-southeast-1 (#694)
  • Elasticsearch automated snapshots fails to delete old ones (#693)
  • UI: wrong units displayed in graphs (#684)
  • WebDriver: variables not detected when used in script parameters (#683)
  • JMX Import: ignore WebDriver configurations (#682)

Enhancements

  • JMeter Images: upgrade to Ubuntu 18.04LTS (#698)
  • Performance: reduce number of http samples being sent (#697)
  • Elasticsearch: automated snapshots through yml configuration (#687)

9.2.0 (12th July 2018)

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.2.0
  • octoperf/enterprise-ui:9.2.0
  • octoperf/enterprise-documentation:9.2.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.1
  • octoperf/jmeter-standard:9.0.1
  • octoperf/jmeter-webdriver:9.0.1

Bug Fixes

  • CSV variables used in WebDriver parameters aren't exported in JMX (#680)
  • CSV variables used in WebDriver scripts aren't exported in JMX (#679)
  • files named with Uppercase chars could not be found during test (#674)
  • JMX Import: Scripts at test plan level are not imported (#663)

Enhancements

  • Upgrade to Elasticsearch 6.3.1 (#678)
  • Add support for WebDriver parameters field (#675)
  • Virtual user validation is updating live during the run (#672)
  • Increase maximum settable memory by profile to 128MB (#667)
  • AWS Provider: ability to configure memory, shutdown policy and cloud instances (#666)
  • Cloud Providers: change zones from map to list to better support AWS Accounts with lots of VPCs (#662)

9.1.0 (2nd July 2018)

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.1.0
  • octoperf/enterprise-ui:9.1.0
  • octoperf/enterprise-documentation:9.1.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.0
  • octoperf/jmeter-standard:9.0.1
  • octoperf/jmeter-webdriver:9.0.1

Bug Fixes

  • Only Private docker providers can be created (#657)
  • Fix licences panel in UI (#654)
  • Properly import JMX when Authentication Manager is empty (#651)

Enhancements

  • Improve Guided Tour (#653)
  • Automatically detect and downloading JMeter Plugins when importing JMX (#652)
  • Upgrade various internal libraries (#647 and #648)
  • Upgrade to Elasticsearch 6.3.0 (#644)
  • Cloud Providers: Support AWS Elastic IPs and DigitalOcean Floating IPs (#635)

9.0.1 (18th June 2018)

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.0.1
  • octoperf/enterprise-ui:9.0.1
  • octoperf/enterprise-documentation:9.0.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
  • octoperf/jmeter-standard:9.0.1
  • octoperf/jmeter-webdriver:9.0.1

Bug Fixes

  • JMX: Server is imported as https with port 80 (#646)
  • ServerAgentService.isIdle should ignore Exited containers (#643)
  • Stale Tests are not finished after xx minutes (#642)
  • Windows process monitor 404 (#639)
  • JMX Import Issue with Test Fragments (#633)
  • Do not import headers starting with : (#630)
  • JMeter script tries to send agent logs (#629)
  • Disabled Agent Seen as Down (#628)
  • Agent Randomly appears as disconnected when high-availability is enabled (#627)

Enhancements

  • Upgrade various external libraries (#641)
  • Improve Test Initialization logs (#632)

9.0.0 (1st June 2018)

Major change: As of 9.0.0 and above, Rancher is not used for load generators anymore.

Docker Images

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.0.0
  • octoperf/enterprise-ui:9.0.0
  • octoperf/enterprise-documentation:9.0.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
  • octoperf/jmeter-standard:9.0.0
  • octoperf/jmeter-webdriver:9.0.0

Bug Fixes

  • Importing Firefox 60 and above HAR could fail (#614)
  • JMX Import was not properly importing timers (#619)
  • Increase Extra Memory Percent to improve small machines usage (#620)

Enhancements

  • Rancher is no longer required to run OctoPerf EE (#609)
  • Scenario and Results views feature a World Map

8.3.0 (19th April 2018)

Bug Fixes

  • Upgrade to Spring Boot 2, Elasticsearch 6.2.3 and other various libraries (#586)
  • Parse ${__P(name,value)} variable on JMX import (#601)
  • CSV File splitting is not working properly when column names inside as first line (#603)

8.2.0 (26th March 2018)

Enhancements

  • Design: Correlation rules frameworks update (#590)
  • Design: Virtual user validation now display 4XX+ on record as errors (#270)
  • Design: Copy/ paste refactor (#558)
  • Design: Autocompletion in server configuration (#562)
  • Design: Pin Validate Virtual User panel if one is running when opening a VU (#570)
  • Design: Sanity Check displays an error on query parameter with empty name and value (#550)
  • Monitoring: Support Prometheus monitoring (#500)
  • Runtime: Reduce default memory used by JMeter to download large files (#581)
  • Runtime: Custom load policy (#556 and #587)
  • Analysis: Add 99 percentile to result table (#566)
  • UI: Documentation lazy loading (#557)
  • UI: Update fontawesome to latest version (#547)

Bug Fixes

  • JMX Import: Regexp Extractor with body unescaped should be imported as extractor on body (#580)
  • Design: PUT request contains invalid chars in body (#582)
  • Design: Selenium webdriver request tab not showing the URL accessed (#574)
  • Design: PUT request body must be raw (Name/Value post parameters are ignored by JMeter in PUT / PATCH requests) (#573)
  • Design: Https Server Port is 80 instead of 443 on JMX Import (#560)
  • Design: Search and replace hangs (#565)
  • Runtime: URL Parameter not encoded at replay by JMeter (#569)
  • Runtime: M5.xlarge not available in all zones (#555)
  • Runtime: JMX: If Controller is not properly configured (#561)
  • Runtime: ThinktimeText is causing issues in JMX with DelayAction (#559)
  • Analysis: Sent bytes always shows 0 in summary with containers (#567)
  • Analysis: Result table sort on numeric values (#564)

8.1.0 (15th February 2018)

Enhancements

  • Upgrade from Elasticsearch 6.1.2 to 6.2.1 (#545)
  • Upgrade various internal libraries (#545 bis)
  • Support variables in Thinktimes (#544)
  • Upgrade from JMeter 3.3 to 4.0 (#546)
  • Support JMeter LoopController (#526)
  • UI: Improve Scenario Profile Edition (#539)
  • UI: Automatically pin buttons when searching / running a validation (#537)
  • UI: Improve test start time visibility (#532)
  • UI: Replace Toaster warning messages by notifications (#531)
  • UI: Update various dependencies (#531)
  • UI: Allow child actions for JMeterAction (#527)
  • UI: Improve Printable Test Report (#530)
  • UI: Improve Results Trend Chart (#522)

Bug Fixes

  • JMX Import: support HTTP Request Defaults with no port or scheme (#549)
  • Fix: Post Parameters with only name have equals included (#543)
  • JMX Import: Fix edge cases (#542)
  • UI: Autosave may not kick in on page change (#535)
  • UI: Fix a scrolling issue when viewing test reports (#528)
  • Fix a possible NPE when importing HAR from latest Chrome version (#523)

8.0.1 (4th February 2018)

Enhancements

  • UI: Confirm dialog before stopping the test (#513)
  • UI: In monitoring, skip resources panel when none required by the monitor (#485)

Bug Fixes

  • JMX Import: support JMX generated by third party tools like Taurus (#521)
  • UI: Report summary has no scrollbar (#520)
  • UI: Clear BenchInformationResource cache (#518)
  • JMX Import: properly handle http request defaults port (#515)
  • UI: Various small cosmetic issues (#514)

8.0.0 (12th January 2018)

Warning

Please carefully follow 7.5.x to 8.0.x Migration guide prior to upgrading to 8.0.x.

Enhancements

  • Comparison: compare results across several test results
  • Upgrade to Elasticsearch 6.1.1

7.5.2 (19th December 2017)

Bug Fixes

  • Latest Chrome Browser HARs are imported in reversed chronological order (#499)

7.5.1 (6th December 2017)

Bug Fixes

  • Plain Post Data Encoding in exported JMX is invalid in some cases (#492)
  • Analysis Results Table column order is randomly changing (#486)

7.5.0 (28th November 2017)

Enhancements

  • Single Sign-On (SSO): LDAP authentication (#351)
  • Backend supports Startup Delay support in UserLoad in Scenarios (#477)

Bug Fixes

  • JMeter JMX with WebDriver is not marked as WebDriver (#488)

7.4.1 (23th November 2017)

Bug Fixes

  • Raw Post Body containing CRLF must be encoded properly in JMX (#483)
  • CSV Variable Balancing may not work properly in some edge cases (#481)
  • Http Server Authentication did not support absolute URLs (#480)
  • User login must be case-insensitive (#467)

7.4.0 (17th November 2017)

Enhancements

  • OctoPerf SLA : Service Level Agreement profiles are configurable in the Design / Monitoring and visible in the test reports.
  • Load Injector monitoring : added threshold alarms when CPU usage is over 80%.
  • HTTP Servers : Connection and Response Timeouts are now configurable per server.
  • Correlation Rules Frameworks : updated the SAML and .Net frameworks.
  • Virtual User Cleanup : when removing SLA profiles or HTTP Servers, empty containers are also removed.
  • Report Trends : the analysis page show a trend graph if showing the response time and hits/errors counts for all selected reports.
  • Frontend optimization : the design page and the search & replace for big Virtual Users (hundreds of actions) is now faster.
  • HTTP headers auto-completion : common HTTP request actions header names are now suggested during edition.
  • Test report summary : to quickly navigate in the report, a summary is displayed on the right.
  • ElasticSearch upgrade to version 5.6.4.

Bug Fixes

  • [Design] Correlation rules injections 'with name' field is left to an empty string when it is cleared.
  • [Design] The displayed number of items currently in the trash is wrong after an action is dropped back into the Virtual User.
  • [Design] JMX import may throw a ClassCastException.

7.3.4 (21th October 2017)

Bug Fixes

  • [Design] HTTP Query Parameters with only name aren't within the JMX Script

7.3.3 (20th October 2017)

Bug Fixes

  • [Monitoring] HTTP 400 Bad Request when listing Monitoring Agents

7.3.2 (19th October 2017)

Enhancements

  • OctoPerf Catalog: configurable data volume mapping

Bug Fixes

  • [Design] HAR Import: ignore query params with empty name and value bug design
  • [Design] Bulk server deletion make encounter race condition
  • [Design]¬†Create Default Correlation Frameworks if none found

7.3.1 (18th October 2017)

Bug Fixes

  • Jenkins JUnit Report were broken
  • Monitoring fails with Http 503 error with restricted workspace rights
  • Query parameters are always written in Path (JMeter JMX)
  • HAR import: query parameters with only value are treated as name only
  • Jenkins: Report link points to Saas when using Enterprise-Edition