Release Notes

Info

IMPORTANT: Make sure to backup your database before performing any upgrade. Once the database is upgraded, it cannot be downgraded.

11.4.1 (7th January 2020)

Docker Images

  • octoperf/docker-agent:11.2.0
  • octoperf/enterprise-edition:11.4.1
  • octoperf/enterprise-ui:11.4.1
  • octoperf/enterprise-documentation:11.4.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
  • octoperf/jmeter-standard:11.4.1
  • octoperf/jmeter-webdriver:11.4.1

Bug Fixes

  • [Runtime] Prevent StackOverflowError when having an empty Link action (#1088)
  • [Design] UI: auto-completion in URLs Must Match download resources field (#1086)

11.4.0 (3rd December 2019)

Docker Images

  • octoperf/docker-agent:11.2.0
  • octoperf/enterprise-edition:11.4.0
  • octoperf/enterprise-ui:11.4.0
  • octoperf/enterprise-documentation:11.4.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
  • octoperf/jmeter-standard:11.4.1
  • octoperf/jmeter-webdriver:11.4.1

Enhancements

  • [Design] Increase Regexp Extractor default offset to 20 (#1085)
  • [Runtime] Return HTTP code 304 Not Modified in validation when request is cached instead of 200 OK (#1084)
  • [Runtime] Download JMeter Plugins on the fly on JMeter side (#1082)
  • [Runtime] Upgrade to JMeter 5.2.1 (#1077)
  • [Runtime] Improve Dynatrace APM HTTP headers (#1075)
  • [Analysis] Display exact time (instead of "x days ago") in results list (#1072)
  • [Runtime] Improve JMeter CPU Usage by reducing number of threads used to aggregate results (#1071)
  • [Runtime] Decrease database pressure when virtual user profile contains 500+ requests (#1070)

Bug Fixes

  • [Design] Add missing Http Status Codes in UI (#)
  • [Runtime] Properly parse / split multiline CSV files (#1076)
  • [Design] Import JMX generated by third party tools with alternate XML structure (#1074)
  • [Runtime] Recover from DigitalOcean which fails to create droplet (#1067)
  • [Runtime] JMeter URL Encoding issues in path with special chars (#890)

11.3.1 (14th November 2019)

Docker Images

  • octoperf/docker-agent:11.2.0
  • octoperf/enterprise-edition:11.3.1
  • octoperf/enterprise-ui:11.3.1
  • octoperf/enterprise-documentation:11.3.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
  • octoperf/jmeter-standard:11.2.0
  • octoperf/jmeter-webdriver:11.2.0

Bug Fixes

  • [Runtime] Disable Clear DNS Cache by default due to high CPU Usage (#1069)
  • [Design] JMX Import: support XML 1.1 escaped characters (#1066)
  • Update to Spring Boot 2.2.1.RELEASE (#1064)

11.3.0 (6th November 2019)

This version includes the following new features:

  • Analysis: new advanced metrics like Network Time,
  • Elasticsearch 7.4.2: the database is upgraded from version 7.4.0 to 7.4.2.

Docker Images

  • octoperf/docker-agent:11.2.0
  • octoperf/enterprise-edition:11.3.0
  • octoperf/enterprise-ui:11.3.0
  • octoperf/enterprise-documentation:11.3.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.2
  • octoperf/jmeter-standard:11.2.0
  • octoperf/jmeter-webdriver:11.2.0

Enhancements

  • Upgrade various internal dependencies to latest stable version (#1061)
  • [Design] UI: button to move a container to fragments (#1059)
  • [Design] UI: minor productivity enhancements (#1056)
  • [Design] Auto-Correlation: handle url encoding in request path (#1055)
  • [Runtime] Enable Clear DNS Cache by default (#1052)
  • [Analysis] Add colors to metrics to quickly identify issues (#1048)
  • [Analysis] Add new computed metrics (#1046)
  • [Analysis] Add new metrics to default report template (#1045)

Bug Fixes

  • [Design] Fragments: cycle detected when link points to removed action (#1060)
  • [Design] Handle CSV with columns containing double quotes (#1058)
  • [Analysis] % Errors computation is wrong (#1057)
  • [Design] Fragments: remove select all button when editing link (#1054)
  • [Runtime] JMX: encode non-compliant chars in request path (#1053)
  • [Design] UI: tags with spaces are not working (#1050)
  • [Analysis] UI: fix strange characters in report export (#1049)
  • [Runtime] UI: rename "+" to "Add User Profile" (#1044)

11.2.0 (22nd October 2019)

This version includes the following new features:

  • Modular Scripts: add support for scripts modularity. Share parts of your scripts between multiple scripts to avoid script duplications,
  • New Analysis Metrics: add % successful hits, % errors, successful hits and errors hits,
  • Cloud Instance Startup: improve speed by paralellizing cloud instance provisioning,
  • Elasticsearch 7.4.0: the database is upgraded from version 7.1.1 to 7.4.0.

A Database migration is performed once on first server startup.

Docker Images

  • octoperf/docker-agent:11.2.0
  • octoperf/enterprise-edition:11.2.0
  • octoperf/enterprise-ui:11.2.0
  • octoperf/enterprise-documentation:11.2.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.4.0
  • octoperf/jmeter-standard:11.2.0
  • octoperf/jmeter-webdriver:11.2.0

Enhancements

  • [Database] Upgrade to Elasticsearch 7.4.0 (#1040)
  • Upgrade various internal dependencies to latest stable version (#1036)
  • [Runtime] Parallellize cloud instance provisioning (#1031)
  • [Analysis] New Report metrics such as % errors (#716)
  • [Design] Modular Scripts (#329)

Bug Fixes

  • [Design] JMX Import: take into account CSV Dataset Config ignoreFirstLine property (#1042)
  • [Runtime] Test stuck while in PENDING state due to thread starvation (#1037)
  • [Agent] Fix: agent could not start container due to invalid generated name (#1034)
  • [Analysis] Comparison Report HTTP call fails as Method not allowed (#1030)
  • [Backups] Deleting older Elasticsearch Snapshots fails (#1029)
  • [Runtime] Generate non-offensive load generator names (#893)

11.1.0 (20th September 2019)

This version includes the following new features:

  • Tag virtual users, scenarios and test reports,
  • And Share on-premise providers with multiple workspaces.

A Database migration is performed once on first server startup.

Docker Images

  • octoperf/docker-agent:11.1.0
  • octoperf/enterprise-edition:11.1.0
  • octoperf/enterprise-ui:11.1.0
  • octoperf/enterprise-documentation:11.1.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
  • octoperf/jmeter-standard:11.1.0
  • octoperf/jmeter-webdriver:11.1.0

Enhancements

  • [Design] Ability to tag virtual users, scenarios and test reports (#1011)
  • [Admin] Ability to manage use accounts through admin console (#996)
  • [Workspace] Ability to share a Private Hosts Provider with multiple workspaces (#1017)
  • [Runtime] Convert csv and sh scripts with dos2unix to avoid charset issues (#1018)
  • [Backend] Upgrade internal libraries (#1023)
  • [Design] Search and replace Post Parameters (#1019)
  • [Config] spring.security.debug property to enabled security logs (#1012)
  • [Analysis] add percentiles to summary report item (#1010)
  • [Payment] Stripe: support for 3D secure payment (#908)
  • [Integrations] Support HTTP Webhook (#966)

Bug Fixes

  • [Backup] Retry when failing to delete snapshot because another snapshot is running (#1029)
  • [Runtime] Improve Error handling when failing to create container (#1022)
  • [Runtime] JMX Export: do not include empty post parameters (#1028)
  • [Design] JMX Import: browser compatible headers script must be in Groovy (#1025)
  • [Payment] Subscription audit logs HTTP Error 400 (#1015)
  • [Design] JMX Import: fix duplicate variables imported by different users (#1013)
  • Set server.tomcat.internal_proxies to fix Oauth2 authentication issues (#1008)

11.0.3 (3rd September 2019)

Docker Images

  • octoperf/docker-agent:11.0.0
  • octoperf/enterprise-edition:11.0.3
  • octoperf/enterprise-ui:11.0.3
  • octoperf/enterprise-documentation:11.0.3
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
  • octoperf/jmeter-standard:11.0.2
  • octoperf/jmeter-webdriver:11.0.2

Enhancements

  • [Design] Export list of HTTP servers as CSV (#1003)

Bug Fixes

  • [Security] Oauth2 authentication often fails due to old remaining cookies / session (#1008)
  • [Security] Oauth2 authentication doesn't work when Hazelcast clustering is enabled (#1007)
  • [Security] Cannot login using Oauth2 when registration is disabled (#1005)
  • [Design] Remove incorrect tooltip on NTLM authentication (#1002)
  • [Design] Providers: rename Memory to Total Amount of memory (#1001)
  • [Design] JMX Export: CSV not included when variable used in IP Spoofing (#1000)
  • [Analysis] Active users curves are desync in comparison reports (#999)
  • [Analysis] UI: Threshold line for LG monitoring has no label (#992)

11.0.2 (21th August 2019)

Docker Images

  • octoperf/docker-agent:11.0.0
  • octoperf/enterprise-edition:11.0.2
  • octoperf/enterprise-ui:11.0.2
  • octoperf/enterprise-documentation:11.0.2
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
  • octoperf/jmeter-standard:11.0.2
  • octoperf/jmeter-webdriver:11.0.2

Enhancements

  • [Design] Search: ability to search requests by server hostname (#595)
  • [Validation] Design: add support for Debug Sampler (#970)
  • [Runtime] Improve retry on error when container fails to create on remote agent (#981)
  • [Runtime] AWS: use m5 and t3 instances by default in all regions (#982)
  • [Design] UI: Support multipart filename parameter as variable (#975)
  • [Runtime] UI: update predefined user-agents (#967)
  • UI: fix various typos (#974)
  • [Design] JMX Import: whitelist Result Status Action Handler import (#972)
  • [Design] UI: Display message instead of empty body on Recorded / Check Responses (#963)
  • [Runtime] JMeter: add missing Http Status Codes (#961)
  • [Design] UI: Cookies from Chrome have no capital (#960)
  • [Analysis] UI: hide disabled actions in virtual user tree (#959)
  • [Analysis] Active users curve takes too much time to load on large tests (#958)
  • Upgrade various backend libraries (#957)

Bug Fixes

  • [Providers] AWS: disable Hong-Kong and Bahrain by default (#991)
  • [Design] JMX Import fails when concurrentPool is empty (#976)
  • [Design] JMX Import: Do not import deactivated headers manager (#977)
  • [Runtime] CSV not included in generated JMX when used in server hostname (#968)
  • [Documentation] Enterprise-Edition architecture schema backend port is 8090 not 80 (#987)
  • [Analysis] Active users curve may not load due to elasticsearch buckets limit of 10000 (#984)
  • [Design] UI: "URL Parameter" should be named "Query parameter" (#980)
  • [Analysis] UI: delta table percentages computation is sometimes wrong (#983)
  • [Design] UI: Constant variable name is mandatory (#979)
  • [Design] JMX Import: do not sanitize multipart filename when it contains a variable (#973)
  • [Design] JMX Import: LoopController forever boolean is not handled (#971)
  • [Design] JMX Import: ResponseAssertion isAssumeSuccess is not handled (#969)
  • [Design] JMX Import: Duplicate variables imported when description being set afterwards (#965)
  • [Design] HAR Import: ignore resources loaded from Chrome / Firefox Cache (#962)
  • [Design] UI: Request and Response search preset return no results (#955)
  • [Analysis] UI: switching from hits to containers is not taken into account (#956)

11.0.1 (10th July 2019)

Docker Images

  • octoperf/docker-agent:11.0.0
  • octoperf/enterprise-edition:11.0.1
  • octoperf/enterprise-ui:11.0.1
  • octoperf/enterprise-documentation:11.0.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
  • octoperf/jmeter-standard:11.0.0
  • octoperf/jmeter-webdriver:11.0.0

Enhancements

  • UI: improve drag'n drop when editing a virtual user script (#950)
  • Enterprise: Helm Chart to install on Kubernetes (#947)
  • UI: configurable custom description on login page (#948)
  • UI: upgrade to AngularJS 1.7 (#949)

Bug Fixes

  • Kubernetes: gracefully shutdown backend by trapping TERM signal (#952)
  • UI: fix invalid label in area chart (#953)
  • Elasticsearch: wait until database is started before booting backend (#945)
  • UI: Hide edition widget when exporting report (#942)
  • Runtime: generated JTL has wrong labels (#944)
  • UI: increase sampling delta on analysis report (#943)
  • UI: replace WYSIWYG HTML editors by Markdown editors (#954)

11.0.0 (14th June 2019)

IMPORTANT: carefully follow our 10.6.x to 11.x.x migration guide before upgrading. OctoPerf 11.0.x uses Elasticsearch 7.1.1.

Docker Images

  • octoperf/docker-agent:11.0.0
  • octoperf/enterprise-edition:11.0.0
  • octoperf/enterprise-ui:11.0.0
  • octoperf/enterprise-documentation:11.0.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
  • octoperf/jmeter-standard:11.0.0
  • octoperf/jmeter-webdriver:11.0.0

Enhancements

  • Docker Images: upgrade to Java JDK 11.0.3
  • Upgrade Elasticsearch from 6.8.0 to 7.1.1 (#933)
  • Elasticsearch: use Rest High Level Client instead of Transport Client (#933)
  • Upgrad internal libraries to latest minor version (#937)
  • Upgrade Hazelcast to 3.11.4 (#931)
  • Saas: enable Google social login (#939)

Bug Fixes

  • SLA: Threshold may generate more alerts than necessary (#940)
  • UI: Runtime regions globe has display issues on Firefox (#936)
  • UI: report area chart is not displaying errors correctly (#935)
  • UI: results tree doesn't work when request name contains HTML (#934)
  • Elasticsearch: properly clear scroll when finished (#938)

10.6.1 (5th June 2019)

Docker Images

  • octoperf/docker-agent:10.6.0
  • octoperf/enterprise-edition:10.6.1
  • octoperf/enterprise-ui:10.6.1
  • octoperf/enterprise-documentation:10.6.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.8.0
  • octoperf/jmeter-standard:10.6.1
  • octoperf/jmeter-webdriver:10.6.1

Bug Fixes

  • Agent: Load Generator monitoring may fail when using large csv datasets (#929)
  • Runtime: fix race condition between host deactivation and PREPARING tests possibly using them (#926)
  • Runtime: Properly terminate containers in case an error occurs while starting the test (#925)

10.6.0 (23th May 2019)

Major changes:

  • Elasticsearch: upgrade from 6.5.4 to 6.8.0,
  • Cloud Providers: support Microsoft Azure cloud provider,
  • Single Sign-On: support Oauth2 / OpenID Connect authentication.

Docker Images

  • octoperf/docker-agent:10.6.0
  • octoperf/enterprise-edition:10.6.0
  • octoperf/enterprise-ui:10.6.0
  • octoperf/enterprise-documentation:10.6.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.8.0
  • octoperf/jmeter-standard:10.5.1
  • octoperf/jmeter-webdriver:10.5.1

Enhancements

  • Elasticsearch: upgrade from 6.5.4 to 6.8.0 (#899)
  • Runtime: Support Microsoft Azure Cloud Provider (#858)
  • User Management: Support Oauth2 / OIDC authentication (#904)
  • Docker Agent: improve resiliency by implementing retries and circuit breakers when communicating with backend (#917)
  • Runtime: easily disable non working monitoring connections while launching a test (#645)
  • User Management: properties to enable / disable user registration, password-recovery and explicit login (#907)
  • Runtime: Purge validation requests / responses every night (#914)
  • Analysis: add area chart to default report (#910)
  • Elasticsearch: configurable number of shards / replicas per indice (#912)
  • Upgrade various dependencies to latest version (#909)
  • Analysis: lower errors storage to 2 per request / 100 per instance by default (#903)

Bug Fixes

  • Runtime: test stuck in INITIALIZING phase due to invalid DNS settings (#922)
  • Validation: number of pass/fail in virtual user tree is incorrectly computed (#915)
  • Runtime: log rebooting cloud instances as WARN instead of ERROR (#918)
  • Runtime: escape double quotes in scenario name (#894)
  • Analysis: remove legacy PERFMON sample type (#913)
  • Analysis: Can't add same metric twice in summary item (#891)
  • Maven Plugin scenario not deserialized correctly (#897)

10.5.1 (11th April 2019)

Docker Images

  • octoperf/docker-agent:10.5.0
  • octoperf/enterprise-edition:10.5.1
  • octoperf/enterprise-ui:10.5.1
  • octoperf/enterprise-documentation:10.5.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
  • octoperf/jmeter-standard:10.5.1
  • octoperf/jmeter-webdriver:10.5.1

Bug Fixes

  • Runtime: JMeter Container execution fails when scenarioId ends with "-" (#889)

10.5.0 (4th April 2019)

Docker Images

  • octoperf/docker-agent:10.5.0
  • octoperf/enterprise-edition:10.5.0
  • octoperf/enterprise-ui:10.5.0
  • octoperf/enterprise-documentation:10.5.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
  • octoperf/jmeter-standard:10.5.0
  • octoperf/jmeter-webdriver:10.5.0

Bug Fixes

  • Runtime: properly handle partial failure during PREPARING state (#882)
  • JMeter: Mark requests as error during validation when an exception happens (#872)
  • JMeter JTL: add AssertionFailureMessage in default config (#870)
  • Design: mark query / post param as encoded if name must be encoded (#883)

Enhancements

  • VU Validation: show request as error / failed if an assertion fails (#873)
  • Design: Improve static resources filtering (#886)
  • Analysis: show on each error if assertion failed in errors table (#887)
  • Agent: periodically cleanup octoperf containers stuck in Created / Exited state (#885)
  • Agent: can be used even when docker.sock volume is not mapped (#880)
  • Assertions: support all possible JMeter configurations (#877)
  • Monitoring: Support Prometheus Gauge (#879)
  • Agent: auto-upgrade can be disabled with -e octoperf.auto-update=false (#881)
  • Monitoring: JDBC driver Class.forName no longer required (#876)
  • Disable URL Blacklist when import JMX / HAR (#871)
  • Monitoring: LG % CPU Usage (100 - % CPU Idle) (#868)

10.4.0 (19th March 2019)

Docker Images

  • octoperf/docker-agent:10.3.0
  • octoperf/enterprise-edition:10.4.0
  • octoperf/enterprise-ui:10.4.0
  • octoperf/enterprise-documentation:10.4.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
  • octoperf/jmeter-standard:10.4.0
  • octoperf/jmeter-webdriver:10.4.0

Bug Fixes

  • LG Monitoring: Use % CPU User instead of % CPU Idle (#864)
  • Check VU: fix edge case preventing check vu to be stopped (#862)
  • LDAP: Ability to disable PartialResultException (#860)
  • JMX: Import Regexp Extractor with non-default scope as generic (#859)
  • JMX: Import Regexp Extractor as Generic if not recognized (#855)
  • Agents: improve communication reliability (#857)

Enhancements

  • Upgrade to JMeter 5.1.1 (#866)
  • Error Details: Improve algorithm selecting which error details are kept (#865)
  • Analysis: Pie chart metrics now available as stacked chart too (#854)
  • UI: configurable admin email (when trying to delete a workspace) (#848)
  • Improve Rest API Creation Wizard (#839)
  • UI: Switch to D3.js for userload chart (#819)
  • JSR Pre/Post Processors can be dropped anywhere (#813)
  • Response Assertions: wider support (#813)
  • UI: Ability to Clean Empty Servers (#596)

10.3.0 (5th March 2019)

Docker Images

  • octoperf/docker-agent:10.3.0
  • octoperf/enterprise-edition:10.3.0
  • octoperf/enterprise-ui:10.3.0
  • octoperf/enterprise-documentation:10.3.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
  • octoperf/jmeter-standard:10.3.0
  • octoperf/jmeter-webdriver:10.3.0

Bug Fixes

  • Agent: ignore NotModifiedException on start / stop / remove container (#853)
  • Agent: start container task must be idempotent, ignoring (#850)
  • CSV Files: Check variable usage in JMeterAction properties (#847)

Enhancements

  • Internal Dependencies upgrades (#852)
  • JMeter: upgrade to JMeter 5.1 (#851)
  • Elasticsearch Snapshots: support coma separated list of repositories (#846)

10.2.0 (25th February 2019)

Docker Images

  • octoperf/docker-agent:10.1.0
  • octoperf/enterprise-edition:10.2.0
  • octoperf/enterprise-ui:10.2.0
  • octoperf/enterprise-documentation:10.2.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
  • octoperf/jmeter-standard:10.1.0
  • octoperf/jmeter-webdriver:10.1.0

Bug Fixes

  • AWS Provider: Cannot configure AWS provider because describeImages fails (#833)
  • Bench Logs: in rare cases, an agent not being used may be logged (#834)
  • POST request with single File weren't properly imported from JMeter (#838)
  • Jenkins Plugin: Report URL link is not working (#840)
  • JMeter JMX Export: do not export empty query parameters (#841)

Enhancements

  • OctoPerf Maven Plugin: run your versioned JMX scripts directly from your favorite Continuous Integration server (#726)
  • Upgrade to Elasticsearch 6.5.4 (#826)
  • LG Monitoring: remove % CPU User counter as % CPU Idle is enough (#842)

10.1.1 (7th February 2019)

Docker Images

  • octoperf/docker-agent:10.1.0
  • octoperf/enterprise-edition:10.1.1
  • octoperf/enterprise-ui:10.1.1
  • octoperf/enterprise-documentation:10.1.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:10.1.0
  • octoperf/jmeter-webdriver:10.1.0

Bug Fixes

  • Support expressions like ${__P(key,defaultValue)} in constant throughput thinktime (#828)
  • UI: add Apply All button to Runtime Properties (#827)
  • Report Templates: further filter specific report items / metrics which cannot be fitted into a template (#825)

10.1.0 (5th February 2019)

OctoPerf 10.1 introduces the following major improvements:

  • Docker Private Registries: the backend can be configured to use a private registry to pull jmeter images,
  • Remote Control: Define JMeter properties and remotely change those properties live while the test is running,
  • Report Templates: create your own report templates!

Other changes are listed below.

Docker Images

  • octoperf/docker-agent:10.1.0
  • octoperf/enterprise-edition:10.1.0
  • octoperf/enterprise-ui:10.1.0
  • octoperf/enterprise-documentation:10.1.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:10.1.0
  • octoperf/jmeter-webdriver:10.1.0

Bug Fixes

  • Agent: upgrade may fail because containers list is not filtered properly (#824)
  • Correlation Rules: Avoid duplicates when importing a framework several times (#823)
  • Correlation Rules: .NET rules with overriden encoding are not working properly (#822)

Enhancements

  • Docker: ability to configure a private Docker Registry (#820)
  • Runtime: Remote Control JMeter Properties (#818)
  • APM: Improve Instana Integration (#817)
  • Remove Social Login from Saas platform (#816)
  • Runtime: compute containers to run asynchronously (#814)
  • Analysis: Automatically merge JTL files into a single file (#798)
  • Analysis Report Templates (#474)

10.0.1 (29th January 2019)

This version fixes a regression which has been introduced in 10.0.0.

Docker Images

  • octoperf/docker-agent:10.0.0
  • octoperf/enterprise-edition:10.0.1
  • octoperf/enterprise-ui:10.0.1
  • octoperf/enterprise-documentation:10.0.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:10.0.1
  • octoperf/jmeter-webdriver:10.0.1

Bug Fixes

  • JMeter: CSV Splitter and Rendez-vous agents are not working (#812)

10.0.0 (28th January 2019)

OctoPerf 10 features the following major improvements:

Warning

OctoPerf EE 10.0.0 introduces breaking changes. make sure to read the Migration guide to upgrade from previous versions.

Docker Images

  • octoperf/docker-agent:10.0.0
  • octoperf/enterprise-edition:10.0.0
  • octoperf/enterprise-ui:10.0.0
  • octoperf/enterprise-documentation:10.0.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:10.0.0
  • octoperf/jmeter-webdriver:10.0.0

Bug Fixes

  • UI: Tree view displays invalid containers (#787)

Enhancements

  • Cloud: add support for AWS eu-north-1 region (Stockholm) (#795)
  • APM: add support for Instana (#809)
  • JMeter: run as non-privileged octoperf user (#808)
  • Upgrade codebase from Java JDK 8 to Java JDK 11 (#718)
  • Agent: restrict internal SSH access to octoperf user (#805)
  • JMeter Docker Image: change JMETER_DIR to JMETER_HOME (#806)
  • Agent: --privileged is not required anymore (#804)
  • Docker Images: Run as non-privileged user (#803)
  • Monitoring: Add New-Relic APM monitoring (#799)
  • Clustering: remove Apache Ignite driver (#802)
  • Improve Correlation Rules algorithm (#801)
  • Upgrade to Spring Boot 2.1.2.RELEASE (#786)
  • JMeter: import RandomCSV DataSet as CSV with shuffled rows (#775)
  • Upgrade various internal libraries (#796)

9.8.0 (8th January 2019)

Docker Images

  • octoperf/docker-agent:9.8.0
  • octoperf/enterprise-edition:9.8.0
  • octoperf/enterprise-ui:9.8.0
  • octoperf/enterprise-documentation:9.8.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.8.0
  • octoperf/jmeter-webdriver:9.8.0

Bug Fixes

  • UI: Entity tables sort on name / description is not refreshed (#793)
  • Force content as UTF-8 in http requests (#792)
  • Retrying scaling a test 1x time if waiting for machines for too long (#789)
  • Make Agent communication fail-safe with retries on failure (#788)
  • JMeter JMX: Import causes an NPE (#785)
  • UI: Unpin Button is not working properly (#784)
  • Agent: Upgrade can be stuck if multiple agents are running on the same machine (#782)

Enhancements

  • Support before-test.sh and after-test.sh scripts before / after JMeter test run (#794)

9.7.0 (29th November 2018)

Docker Images

  • octoperf/docker-agent:9.7.0
  • octoperf/enterprise-edition:9.7.0
  • octoperf/enterprise-ui:9.7.0
  • octoperf/enterprise-documentation:9.7.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.5.0
  • octoperf/jmeter-webdriver:9.5.0

Bug Fixes

  • Agent: AgentFailure message incorrectly mapped to AgentMessage (#778)
  • UI: Editing a delay doesn't work (#779)
  • WebDriver: add delay on import to avoid slamming the CPU (#605)
  • Top Throughput: exclude per second metrics (#771)
  • Parallel Sampler: automatically switch PARENT_SAMPLE to false on import (#764)
  • JMX Import: exclude Perfmon collector (#753)
  • Results Tree display issues (#754)
  • Agent: Timeout while pulling image (#773)

Enhancements

  • Clustering: new ignite driver using Apache Ignite (#776)
  • Report Exports: customizable logo and company name (#621)
  • Reports Export: Configurable number of lines in tables (#622)
  • Reports Export: landscape mode (#624)
  • Hazelcast: Upgrade from 3.10.6 to 3.11 (#774)
  • Agent monitoring: add CPU Idle counter (#772)
  • Saas: add twitter feed to login page (#769)

9.6.1 (20th November 2018)

Docker Images

  • octoperf/docker-agent:9.5.0
  • octoperf/enterprise-edition:9.6.1
  • octoperf/enterprise-ui:9.6.1
  • octoperf/enterprise-documentation:9.6.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.5.0
  • octoperf/jmeter-webdriver:9.5.0

Bug Fixes

  • Test may fail to stop properly: JMeter lacks UDP max port (#768)
  • Packer Manifest: properly parse DigitalOcean manifest when copying images during build (#767)
  • JMX Import: when path is a variable, do not add leading slash (#762)
  • VU Deletion: also delete check requests and responses (#681)

9.6.0 (19th November 2018)

Docker Images

  • octoperf/docker-agent:9.5.0
  • octoperf/enterprise-edition:9.6.0
  • octoperf/enterprise-ui:9.6.0
  • octoperf/enterprise-documentation:9.6.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.5.0
  • octoperf/jmeter-webdriver:9.5.0

Enhancements

  • Runtime: add Cookie Policies NETSCAPE and BESTMATCH policies (#765)
  • Analysis: add filters to Result and Error Tables (#763)
  • Design: add Download Resources filter and pool size configuration (#273)

9.5.0 (9th November 2018)

Docker Images

  • octoperf/docker-agent:9.5.0
  • octoperf/enterprise-edition:9.5.0
  • octoperf/enterprise-ui:9.5.0
  • octoperf/enterprise-documentation:9.5.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
  • octoperf/jmeter-standard:9.5.0
  • octoperf/jmeter-webdriver:9.5.0

Bug Fixes

  • Agent upgrade may fail when container not found (#755)

Enhancements

  • IP Spoofing: use multiple network interfaces / IPs to inject load (#760)
  • UI: Reorganize Top Menu (#738)
  • Elasticsearch 6.4.3 (#761)

9.4.2 (25th October 2018)

Docker Images

  • octoperf/docker-agent:9.4.2
  • octoperf/enterprise-edition:9.4.2
  • octoperf/enterprise-ui:9.4.2
  • octoperf/enterprise-documentation:9.4.2
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
  • octoperf/jmeter-standard:9.4.2
  • octoperf/jmeter-webdriver:9.4.2

Bug Fixes

  • Enterprise-edition: password reset template mail is pointing to saas platform (#752)
  • Multipart parameters with Filename as variable (${var}) not handled properly (#692)

Enhancements

  • Proxy Settings: docker-agent now takes into account system proxy env variables (#750)

9.4.1 (17th October 2018)

Docker Images

  • octoperf/docker-agent:9.2.2
  • octoperf/enterprise-edition:9.4.1
  • octoperf/enterprise-ui:9.4.1
  • octoperf/enterprise-documentation:9.4.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
  • octoperf/jmeter-standard:9.4.0
  • octoperf/jmeter-webdriver:9.4.0

Bug Fixes

  • HTTP 403 Access Denied when creating a workspace (#745)
  • When using Medium instances on private AWS account, machine has not enough memory (#740)
  • CSV files imported along with JMX are not properly linked to variables (#739)
  • AppDynamics Header path is in reverse order (#748)

Enhancements

  • Elasticsearch 6.4.2 (#747)
  • UI: Display JSR223 script action args (#744)
  • UI: Comparison Results list not displaying one report (#742)
  • Mail: support much wider possible configurations (#690)

9.4.0 (25th September 2018)

Docker Images

  • octoperf/docker-agent:9.2.2
  • octoperf/enterprise-edition:9.4.0
  • octoperf/enterprise-ui:9.4.0
  • octoperf/enterprise-documentation:9.4.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.1
  • octoperf/jmeter-standard:9.4.0
  • octoperf/jmeter-webdriver:9.4.0

Bug Fixes

  • UserLogin event must be only sent when login is successful (#736)
  • Results Tree is not working properly with WebDriver virtual users (#733)

Enhancements

  • Upgrade many internal libraries to latest version (#731)
  • Upgrade to JMeter 5 (#730)
  • Sanity Check: warn when Host header is different from server hostname (#700)
  • Sanity Check: warn if a CSV file is empty or has no values (#478)
  • Sanity Check: warn if think times are high (greater than 30sec) (#391)
  • Refactor Virtual User creation wizard (#735)

9.3.0 (17th September 2018)

Docker Images

  • octoperf/docker-agent:9.2.2
  • octoperf/enterprise-edition:9.3.0
  • octoperf/enterprise-ui:9.3.0
  • octoperf/enterprise-documentation:9.3.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
  • octoperf/jmeter-standard:9.2.2
  • octoperf/jmeter-webdriver:9.2.2

Bug Fixes

  • Results Sampling: increase sampling when load significantly increases (>=100k vus) (#725)
  • Docker Batches: cleanup batches stuck in CREATED state (#722)
  • Heavy Load Tests: Improve responsiveness and ingestion capacity (#721)
  • UI: Runtime profile bug when adding point on crowded profile (#720)
  • UI: Order Results table by increasing timestamp with millisecond precision (#714)
  • JMX Import: LoopController.loops can be both stringProp and intProp (#711)
  • UI: prevent switching from post body url-encoded to raw (#585)

Enhancements

  • UI: Start OctoPerf on VU creation page (#724)
  • CSVs: split CSV files only when enough values available (#719)
  • Bench Errors: store 100 errors per container (previously 50) (#713)
  • UI: inform user what's going to be deleted when deleting a workspace / project (#712)
  • WebDriver: Use Google Chrome 68 instead of Firefox 47 (#710)
  • Design: Support Http Request Names (#709)
  • Log Agent IPs on test launch (#708)
  • Reports: New Tree Table Report (#706)

9.2.2 (28th August 2018)

When upgrading to 9.2.2+, you will need to upgrade your on-premise agents to the latest version manually. Simply delete and re-create the container using the command-line provided from the UI.

Docker Images

  • octoperf/docker-agent:9.2.2
  • octoperf/enterprise-edition:9.2.2
  • octoperf/enterprise-ui:9.2.2
  • octoperf/enterprise-documentation:9.2.2
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
  • octoperf/jmeter-standard:9.2.2
  • octoperf/jmeter-webdriver:9.2.2

Bug Fixes

  • Agent Upgrade is failing due to improperly mapped volumes (#704)
  • Load Generator network monitoring stats are not working (#701)

Enhancements

  • Add support for a remove-files.txt file to delete files from JMeter (#703)

9.2.1 (9th August 2018)

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.2.1
  • octoperf/enterprise-ui:9.2.1
  • octoperf/enterprise-documentation:9.2.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
  • octoperf/jmeter-standard:9.2.1
  • octoperf/jmeter-webdriver:9.2.1

Bug Fixes

  • Unreachable Hosts should be rebooted after a cooldown period (#696)
  • No m5.xlarge available in ap-southeast-1 (#694)
  • Elasticsearch automated snapshots fails to delete old ones (#693)
  • UI: wrong units displayed in graphs (#684)
  • WebDriver: variables not detected when used in script parameters (#683)
  • JMX Import: ignore WebDriver configurations (#682)

Enhancements

  • JMeter Images: upgrade to Ubuntu 18.04LTS (#698)
  • Performance: reduce number of http samples being sent (#697)
  • Elasticsearch: automated snapshots through yml configuration (#687)

9.2.0 (12th July 2018)

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.2.0
  • octoperf/enterprise-ui:9.2.0
  • octoperf/enterprise-documentation:9.2.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.1
  • octoperf/jmeter-standard:9.0.1
  • octoperf/jmeter-webdriver:9.0.1

Bug Fixes

  • CSV variables used in WebDriver parameters aren't exported in JMX (#680)
  • CSV variables used in WebDriver scripts aren't exported in JMX (#679)
  • files named with Uppercase chars could not be found during test (#674)
  • JMX Import: Scripts at test plan level are not imported (#663)

Enhancements

  • Upgrade to Elasticsearch 6.3.1 (#678)
  • Add support for WebDriver parameters field (#675)
  • Virtual user validation is updating live during the run (#672)
  • Increase maximum settable memory by profile to 128MB (#667)
  • AWS Provider: ability to configure memory, shutdown policy and cloud instances (#666)
  • Cloud Providers: change zones from map to list to better support AWS Accounts with lots of VPCs (#662)

9.1.0 (2nd July 2018)

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.1.0
  • octoperf/enterprise-ui:9.1.0
  • octoperf/enterprise-documentation:9.1.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.0
  • octoperf/jmeter-standard:9.0.1
  • octoperf/jmeter-webdriver:9.0.1

Bug Fixes

  • Only Private docker providers can be created (#657)
  • Fix licences panel in UI (#654)
  • Properly import JMX when Authentication Manager is empty (#651)

Enhancements

  • Improve Guided Tour (#653)
  • Automatically detect and downloading JMeter Plugins when importing JMX (#652)
  • Upgrade various internal libraries (#647 and #648)
  • Upgrade to Elasticsearch 6.3.0 (#644)
  • Cloud Providers: Support AWS Elastic IPs and DigitalOcean Floating IPs (#635)

9.0.1 (18th June 2018)

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.0.1
  • octoperf/enterprise-ui:9.0.1
  • octoperf/enterprise-documentation:9.0.1
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
  • octoperf/jmeter-standard:9.0.1
  • octoperf/jmeter-webdriver:9.0.1

Bug Fixes

  • JMX: Server is imported as https with port 80 (#646)
  • ServerAgentService.isIdle should ignore Exited containers (#643)
  • Stale Tests are not finished after xx minutes (#642)
  • Windows process monitor 404 (#639)
  • JMX Import Issue with Test Fragments (#633)
  • Do not import headers starting with : (#630)
  • JMeter script tries to send agent logs (#629)
  • Disabled Agent Seen as Down (#628)
  • Agent Randomly appears as disconnected when high-availability is enabled (#627)

Enhancements

  • Upgrade various external libraries (#641)
  • Improve Test Initialization logs (#632)

9.0.0 (1st June 2018)

Major change: As of 9.0.0 and above, Rancher is not used for load generators anymore.

Docker Images

  • octoperf/docker-agent:9.0.0
  • octoperf/enterprise-edition:9.0.0
  • octoperf/enterprise-ui:9.0.0
  • octoperf/enterprise-documentation:9.0.0
  • docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
  • octoperf/jmeter-standard:9.0.0
  • octoperf/jmeter-webdriver:9.0.0

Bug Fixes

  • Importing Firefox 60 and above HAR could fail (#614)
  • JMX Import was not properly importing timers (#619)
  • Increase Extra Memory Percent to improve small machines usage (#620)

Enhancements

  • Rancher is no longer required to run OctoPerf EE (#609)
  • Scenario and Results views feature a World Map

8.3.0 (19th April 2018)

Bug Fixes

  • Upgrade to Spring Boot 2, Elasticsearch 6.2.3 and other various libraries (#586)
  • Parse ${__P(name,value)} variable on JMX import (#601)
  • CSV File splitting is not working properly when column names inside as first line (#603)

8.2.0 (26th March 2018)

Enhancements

  • Design: Correlation rules frameworks update (#590)
  • Design: Virtual user validation now display 4XX+ on record as errors (#270)
  • Design: Copy/ paste refactor (#558)
  • Design: Autocompletion in server configuration (#562)
  • Design: Pin Validate Virtual User panel if one is running when opening a VU (#570)
  • Design: Sanity Check displays an error on query parameter with empty name and value (#550)
  • Monitoring: Support Prometheus monitoring (#500)
  • Runtime: Reduce default memory used by JMeter to download large files (#581)
  • Runtime: Custom load policy (#556 and #587)
  • Analysis: Add 99 percentile to result table (#566)
  • UI: Documentation lazy loading (#557)
  • UI: Update fontawesome to latest version (#547)

Bug Fixes

  • JMX Import: Regexp Extractor with body unescaped should be imported as extractor on body (#580)
  • Design: PUT request contains invalid chars in body (#582)
  • Design: Selenium webdriver request tab not showing the URL accessed (#574)
  • Design: PUT request body must be raw (Name/Value post parameters are ignored by JMeter in PUT / PATCH requests) (#573)
  • Design: Https Server Port is 80 instead of 443 on JMX Import (#560)
  • Design: Search and replace hangs (#565)
  • Runtime: URL Parameter not encoded at replay by JMeter (#569)
  • Runtime: M5.xlarge not available in all zones (#555)
  • Runtime: JMX: If Controller is not properly configured (#561)
  • Runtime: ThinktimeText is causing issues in JMX with DelayAction (#559)
  • Analysis: Sent bytes always shows 0 in summary with containers (#567)
  • Analysis: Result table sort on numeric values (#564)

8.1.0 (15th February 2018)

Enhancements

  • Upgrade from Elasticsearch 6.1.2 to 6.2.1 (#545)
  • Upgrade various internal libraries (#545 bis)
  • Support variables in Thinktimes (#544)
  • Upgrade from JMeter 3.3 to 4.0 (#546)
  • Support JMeter LoopController (#526)
  • UI: Improve Scenario Profile Edition (#539)
  • UI: Automatically pin buttons when searching / running a validation (#537)
  • UI: Improve test start time visibility (#532)
  • UI: Replace Toaster warning messages by notifications (#531)
  • UI: Update various dependencies (#531)
  • UI: Allow child actions for JMeterAction (#527)
  • UI: Improve Printable Test Report (#530)
  • UI: Improve Results Trend Chart (#522)

Bug Fixes

  • JMX Import: support HTTP Request Defaults with no port or scheme (#549)
  • Fix: Post Parameters with only name have equals included (#543)
  • JMX Import: Fix edge cases (#542)
  • UI: Autosave may not kick in on page change (#535)
  • UI: Fix a scrolling issue when viewing test reports (#528)
  • Fix a possible NPE when importing HAR from latest Chrome version (#523)

8.0.1 (4th February 2018)

Enhancements

  • UI: Confirm dialog before stopping the test (#513)
  • UI: In monitoring, skip resources panel when none required by the monitor (#485)

Bug Fixes

  • JMX Import: support JMX generated by third party tools like Taurus (#521)
  • UI: Report summary has no scrollbar (#520)
  • UI: Clear BenchInformationResource cache (#518)
  • JMX Import: properly handle http request defaults port (#515)
  • UI: Various small cosmetic issues (#514)

8.0.0 (12th January 2018)

Warning

Please carefully follow 7.5.x to 8.0.x Migration guide prior to upgrading to 8.0.x.

Enhancements

  • Comparison: compare results across several test results
  • Upgrade to Elasticsearch 6.1.1

7.5.2 (19th December 2017)

Bug Fixes

  • Latest Chrome Browser HARs are imported in reversed chronological order (#499)

7.5.1 (6th December 2017)

Bug Fixes

  • Plain Post Data Encoding in exported JMX is invalid in some cases (#492)
  • Analysis Results Table column order is randomly changing (#486)

7.5.0 (28th November 2017)

Enhancements

  • Single Sign-On (SSO): LDAP authentication (#351)
  • Backend supports Startup Delay support in UserLoad in Scenarios (#477)

Bug Fixes

  • JMeter JMX with WebDriver is not marked as WebDriver (#488)

7.4.1 (23th November 2017)

Bug Fixes

  • Raw Post Body containing CRLF must be encoded properly in JMX (#483)
  • CSV Variable Balancing may not work properly in some edge cases (#481)
  • Http Server Authentication did not support absolute URLs (#480)
  • User login must be case-insensitive (#467)

7.4.0 (17th November 2017)

Enhancements

  • OctoPerf SLA : Service Level Agreement profiles are configurable in the Design / Monitoring and visible in the test reports.
  • Load Injector monitoring : added threshold alarms when CPU usage is over 80%.
  • HTTP Servers : Connection and Response Timeouts are now configurable per server.
  • Correlation Rules Frameworks : updated the SAML and .Net frameworks.
  • Virtual User Cleanup : when removing SLA profiles or HTTP Servers, empty containers are also removed.
  • Report Trends : the analysis page show a trend graph if showing the response time and hits/errors counts for all selected reports.
  • Frontend optimization : the design page and the search & replace for big Virtual Users (hundreds of actions) is now faster.
  • HTTP headers auto-completion : common HTTP request actions header names are now suggested during edition.
  • Test report summary : to quickly navigate in the report, a summary is displayed on the right.
  • ElasticSearch upgrade to version 5.6.4.

Bug Fixes

  • [Design] Correlation rules injections 'with name' field is left to an empty string when it is cleared.
  • [Design] The displayed number of items currently in the trash is wrong after an action is dropped back into the Virtual User.
  • [Design] JMX import may throw a ClassCastException.

7.3.4 (21th October 2017)

Bug Fixes

  • [Design] HTTP Query Parameters with only name aren't within the JMX Script

7.3.3 (20th October 2017)

Bug Fixes

  • [Monitoring] HTTP 400 Bad Request when listing Monitoring Agents

7.3.2 (19th October 2017)

Enhancements

  • OctoPerf Catalog: configurable data volume mapping

Bug Fixes

  • [Design] HAR Import: ignore query params with empty name and value bug design
  • [Design] Bulk server deletion make encounter race condition
  • [Design] Create Default Correlation Frameworks if none found

7.3.1 (18th October 2017)

Bug Fixes

  • Jenkins JUnit Report were broken
  • Monitoring fails with Http 503 error with restricted workspace rights
  • Query parameters are always written in Path (JMeter JMX)
  • HAR import: query parameters with only value are treated as name only
  • Jenkins: Report link points to Saas when using Enterprise-Edition