Release Notes

Info

IMPORTANT: Make sure to backup your database before performing any upgrade. Once the database is upgraded, it cannot be downgraded.

11.1.0 (20th September 2019)

This version introduces the following major features:

• Tag virtual users, scenarios and test reports,
• And Share on-premise providers with multiple workspaces.

A database migration is performed:

• octoperf_dockerprovider: workspaceId field is removed from each provider,
• octoperf_dockerprovidertoworkspace: new indice to link providers to workspaces.

Docker Images

• octoperf/docker-agent:11.1.0
• octoperf/enterprise-edition:11.1.0
• octoperf/enterprise-ui:11.1.0
• octoperf/enterprise-documentation:11.1.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
• octoperf/jmeter-standard:11.1.0
• octoperf/jmeter-webdriver:11.1.0

Enhancements

• [Design] Ability to tag virtual users, scenarios and test reports (#1011)
• [Admin] Ability to manage use accounts through admin console (#996)
• [Workspace] Ability to share a Private Hosts Provider with multiple workspaces (#1017)
• [Runtime] Convert csv and sh scripts with dos2unix to avoid charset issues (#1018)
• [Backend] Upgrade internal libraries (#1023)
• [Design] Search and replace Post Parameters (#1019)
• [Config] spring.security.debug property to enabled security logs (#1012)
• [Analysis] add percentiles to summary report item (#1010)
• [Payment] Stripe: support for 3D secure payment (#908)
• [Integrations] Support HTTP Webhook (#966)

Bug Fixes

• [Backup] Retry when failing to delete snapshot because another snapshot is running (#1029)
• [Runtime] Improve Error handling when failing to create container (#1022)
• [Runtime] JMX Export: do not include empty post parameters (#1028)
• [Design] JMX Import: browser compatible headers script must be in Groovy (#1025)
• [Payment] Subscription audit logs HTTP Error 400 (#1015)
• [Design] JMX Import: fix duplicate variables imported by different users (#1013)
• Set server.tomcat.internal_proxies to fix Oauth2 authentication issues (#1008)

11.0.3 (3rd September 2019)

Docker Images

• octoperf/docker-agent:11.0.0
• octoperf/enterprise-edition:11.0.3
• octoperf/enterprise-ui:11.0.3
• octoperf/enterprise-documentation:11.0.3
• docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
• octoperf/jmeter-standard:11.0.2
• octoperf/jmeter-webdriver:11.0.2

Enhancements

• [Design] Export list of HTTP servers as CSV (#1003)

Bug Fixes

• [Security] Oauth2 authentication often fails due to old remaining cookies / session (#1008)
• [Security] Oauth2 authentication doesn't work when Hazelcast clustering is enabled (#1007)
• [Security] Cannot login using Oauth2 when registration is disabled (#1005)
• [Design] Remove incorrect tooltip on NTLM authentication (#1002)
• [Design] Providers: rename Memory to Total Amount of memory (#1001)
• [Design] JMX Export: CSV not included when variable used in IP Spoofing (#1000)
• [Analysis] Active users curves are desync in comparison reports (#999)
• [Analysis] UI: Threshold line for LG monitoring has no label (#992)

11.0.2 (21th August 2019)

Docker Images

• octoperf/docker-agent:11.0.0
• octoperf/enterprise-edition:11.0.2
• octoperf/enterprise-ui:11.0.2
• octoperf/enterprise-documentation:11.0.2
• docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
• octoperf/jmeter-standard:11.0.2
• octoperf/jmeter-webdriver:11.0.2

Enhancements

• [Design] Search: ability to search requests by server hostname (#595)
• [Validation] Design: add support for Debug Sampler (#970)
• [Runtime] Improve retry on error when container fails to create on remote agent (#981)
• [Runtime] AWS: use m5 and t3 instances by default in all regions (#982)
• [Design] UI: Support multipart filename parameter as variable (#975)
• [Runtime] UI: update predefined user-agents (#967)
• UI: fix various typos (#974)
• [Design] JMX Import: whitelist Result Status Action Handler import (#972)
• [Design] UI: Display message instead of empty body on Recorded / Check Responses (#963)
• [Runtime] JMeter: add missing Http Status Codes (#961)
• [Design] UI: Cookies from Chrome have no capital (#960)
• [Analysis] UI: hide disabled actions in virtual user tree (#959)
• [Analysis] Active users curve takes too much time to load on large tests (#958)
• Upgrade various backend libraries (#957)

Bug Fixes

• [Providers] AWS: disable Hong-Kong and Bahrain by default (#991)
• [Design] JMX Import fails when concurrentPool is empty (#976)
• [Design] JMX Import: Do not import deactivated headers manager (#977)
• [Runtime] CSV not included in generated JMX when used in server hostname (#968)
• [Documentation] Enterprise-Edition architecture schema backend port is 8090 not 80 (#987)
• [Analysis] Active users curve may not load due to elasticsearch buckets limit of 10000 (#984)
• [Design] UI: "URL Parameter" should be named "Query parameter" (#980)
• [Analysis] UI: delta table percentages computation is sometimes wrong (#983)
• [Design] UI: Constant variable name is mandatory (#979)
• [Design] JMX Import: do not sanitize multipart filename when it contains a variable (#973)
• [Design] JMX Import: LoopController forever boolean is not handled (#971)
• [Design] JMX Import: ResponseAssertion isAssumeSuccess is not handled (#969)
• [Design] JMX Import: Duplicate variables imported when description being set afterwards (#965)
• [Design] HAR Import: ignore resources loaded from Chrome / Firefox Cache (#962)
• [Design] UI: Request and Response search preset return no results (#955)
• [Analysis] UI: switching from hits to containers is not taken into account (#956)

11.0.1 (10th July 2019)

Docker Images

• octoperf/docker-agent:11.0.0
• octoperf/enterprise-edition:11.0.1
• octoperf/enterprise-ui:11.0.1
• octoperf/enterprise-documentation:11.0.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
• octoperf/jmeter-standard:11.0.0
• octoperf/jmeter-webdriver:11.0.0

Enhancements

• UI: improve drag'n drop when editing a virtual user script (#950)
• Enterprise: Helm Chart to install on Kubernetes (#947)
• UI: configurable custom description on login page (#948)
• UI: upgrade to AngularJS 1.7 (#949)

Bug Fixes

• Kubernetes: gracefully shutdown backend by trapping TERM signal (#952)
• UI: fix invalid label in area chart (#953)
• Elasticsearch: wait until database is started before booting backend (#945)
• UI: Hide edition widget when exporting report (#942)
• Runtime: generated JTL has wrong labels (#944)
• UI: increase sampling delta on analysis report (#943)
• UI: replace WYSIWYG HTML editors by Markdown editors (#954)

11.0.0 (14th June 2019)

IMPORTANT: carefully follow our 10.6.x to 11.x.x migration guide before upgrading. OctoPerf 11.0.x uses Elasticsearch 7.1.1.

Docker Images

• octoperf/docker-agent:11.0.0
• octoperf/enterprise-edition:11.0.0
• octoperf/enterprise-ui:11.0.0
• octoperf/enterprise-documentation:11.0.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:7.1.1
• octoperf/jmeter-standard:11.0.0
• octoperf/jmeter-webdriver:11.0.0

Enhancements

• Docker Images: upgrade to Java JDK 11.0.3
• Upgrade Elasticsearch from 6.8.0 to 7.1.1 (#933)
• Elasticsearch: use Rest High Level Client instead of Transport Client (#933)
• Upgrad internal libraries to latest minor version (#937)
• Upgrade Hazelcast to 3.11.4 (#931)
• Saas: enable Google social login (#939)

Bug Fixes

• SLA: Threshold may generate more alerts than necessary (#940)
• UI: Runtime regions globe has display issues on Firefox (#936)
• UI: report area chart is not displaying errors correctly (#935)
• UI: results tree doesn't work when request name contains HTML (#934)
• Elasticsearch: properly clear scroll when finished (#938)

10.6.1 (5th June 2019)

Docker Images

• octoperf/docker-agent:10.6.0
• octoperf/enterprise-edition:10.6.1
• octoperf/enterprise-ui:10.6.1
• octoperf/enterprise-documentation:10.6.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.8.0
• octoperf/jmeter-standard:10.6.1
• octoperf/jmeter-webdriver:10.6.1

Bug Fixes

• Agent: Load Generator monitoring may fail when using large csv datasets (#929)
• Runtime: fix race condition between host deactivation and PREPARING tests possibly using them (#926)
• Runtime: Properly terminate containers in case an error occurs while starting the test (#925)

10.6.0 (23th May 2019)

Major changes:

• Elasticsearch: upgrade from 6.5.4 to 6.8.0,
• Cloud Providers: support Microsoft Azure cloud provider,
• Single Sign-On: support Oauth2 / OpenID Connect authentication.

Docker Images

• octoperf/docker-agent:10.6.0
• octoperf/enterprise-edition:10.6.0
• octoperf/enterprise-ui:10.6.0
• octoperf/enterprise-documentation:10.6.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.8.0
• octoperf/jmeter-standard:10.5.1
• octoperf/jmeter-webdriver:10.5.1

Enhancements

• Elasticsearch: upgrade from 6.5.4 to 6.8.0 (#899)
• Runtime: Support Microsoft Azure Cloud Provider (#858)
• User Management: Support Oauth2 / OIDC authentication (#904)
• Docker Agent: improve resiliency by implementing retries and circuit breakers when communicating with backend (#917)
• Runtime: easily disable non working monitoring connections while launching a test (#645)
• User Management: properties to enable / disable user registration, password-recovery and explicit login (#907)
• Runtime: Purge validation requests / responses every night (#914)
• Analysis: add area chart to default report (#910)
• Elasticsearch: configurable number of shards / replicas per indice (#912)
• Upgrade various dependencies to latest version (#909)
• Analysis: lower errors storage to 2 per request / 100 per instance by default (#903)

Bug Fixes

• Runtime: test stuck in INITIALIZING phase due to invalid DNS settings (#922)
• Validation: number of pass/fail in virtual user tree is incorrectly computed (#915)
• Runtime: log rebooting cloud instances as WARN instead of ERROR (#918)
• Runtime: escape double quotes in scenario name (#894)
• Analysis: remove legacy PERFMON sample type (#913)
• Analysis: Can't add same metric twice in summary item (#891)
• Maven Plugin scenario not deserialized correctly (#897)

10.5.1 (11th April 2019)

Docker Images

• octoperf/docker-agent:10.5.0
• octoperf/enterprise-edition:10.5.1
• octoperf/enterprise-ui:10.5.1
• octoperf/enterprise-documentation:10.5.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
• octoperf/jmeter-standard:10.5.1
• octoperf/jmeter-webdriver:10.5.1

Bug Fixes

• Runtime: JMeter Container execution fails when scenarioId ends with "-" (#889)

10.5.0 (4th April 2019)

Docker Images

• octoperf/docker-agent:10.5.0
• octoperf/enterprise-edition:10.5.0
• octoperf/enterprise-ui:10.5.0
• octoperf/enterprise-documentation:10.5.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
• octoperf/jmeter-standard:10.5.0
• octoperf/jmeter-webdriver:10.5.0

Bug Fixes

• Runtime: properly handle partial failure during PREPARING state (#882)
• JMeter: Mark requests as error during validation when an exception happens (#872)
• JMeter JTL: add AssertionFailureMessage in default config (#870)
• Design: mark query / post param as encoded if name must be encoded (#883)

Enhancements

• VU Validation: show request as error / failed if an assertion fails (#873)
• Design: Improve static resources filtering (#886)
• Analysis: show on each error if assertion failed in errors table (#887)
• Agent: periodically cleanup octoperf containers stuck in Created / Exited state (#885)
• Agent: can be used even when docker.sock volume is not mapped (#880)
• Assertions: support all possible JMeter configurations (#877)
• Monitoring: Support Prometheus Gauge (#879)
• Agent: auto-upgrade can be disabled with -e octoperf.auto-update=false (#881)
• Monitoring: JDBC driver Class.forName no longer required (#876)
• Disable URL Blacklist when import JMX / HAR (#871)
• Monitoring: LG % CPU Usage (100 - % CPU Idle) (#868)

10.4.0 (19th March 2019)

Docker Images

• octoperf/docker-agent:10.3.0
• octoperf/enterprise-edition:10.4.0
• octoperf/enterprise-ui:10.4.0
• octoperf/enterprise-documentation:10.4.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
• octoperf/jmeter-standard:10.4.0
• octoperf/jmeter-webdriver:10.4.0

Bug Fixes

• LG Monitoring: Use % CPU User instead of % CPU Idle (#864)
• Check VU: fix edge case preventing check vu to be stopped (#862)
• LDAP: Ability to disable PartialResultException (#860)
• JMX: Import Regexp Extractor with non-default scope as generic (#859)
• JMX: Import Regexp Extractor as Generic if not recognized (#855)
• Agents: improve communication reliability (#857)

Enhancements

• Upgrade to JMeter 5.1.1 (#866)
• Error Details: Improve algorithm selecting which error details are kept (#865)
• Analysis: Pie chart metrics now available as stacked chart too (#854)
• UI: configurable admin email (when trying to delete a workspace) (#848)
• Improve Rest API Creation Wizard (#839)
• UI: Switch to D3.js for userload chart (#819)
• JSR Pre/Post Processors can be dropped anywhere (#813)
• Response Assertions: wider support (#813)
• UI: Ability to Clean Empty Servers (#596)

10.3.0 (5th March 2019)

Docker Images

• octoperf/docker-agent:10.3.0
• octoperf/enterprise-edition:10.3.0
• octoperf/enterprise-ui:10.3.0
• octoperf/enterprise-documentation:10.3.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
• octoperf/jmeter-standard:10.3.0
• octoperf/jmeter-webdriver:10.3.0

Bug Fixes

• Agent: ignore NotModifiedException on start / stop / remove container (#853)
• Agent: start container task must be idempotent, ignoring (#850)
• CSV Files: Check variable usage in JMeterAction properties (#847)

Enhancements

• Internal Dependencies upgrades (#852)
• JMeter: upgrade to JMeter 5.1 (#851)
• Elasticsearch Snapshots: support coma separated list of repositories (#846)

10.2.0 (25th February 2019)

Docker Images

• octoperf/docker-agent:10.1.0
• octoperf/enterprise-edition:10.2.0
• octoperf/enterprise-ui:10.2.0
• octoperf/enterprise-documentation:10.2.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
• octoperf/jmeter-standard:10.1.0
• octoperf/jmeter-webdriver:10.1.0

Bug Fixes

• AWS Provider: Cannot configure AWS provider because describeImages fails (#833)
• Bench Logs: in rare cases, an agent not being used may be logged (#834)
• POST request with single File weren't properly imported from JMeter (#838)
• Jenkins Plugin: Report URL link is not working (#840)
• JMeter JMX Export: do not export empty query parameters (#841)

Enhancements

• OctoPerf Maven Plugin: run your versioned JMX scripts directly from your favorite Continuous Integration server (#726)
• Upgrade to Elasticsearch 6.5.4 (#826)
• LG Monitoring: remove % CPU User counter as % CPU Idle is enough (#842)

10.1.1 (7th February 2019)

Docker Images

• octoperf/docker-agent:10.1.0
• octoperf/enterprise-edition:10.1.1
• octoperf/enterprise-ui:10.1.1
• octoperf/enterprise-documentation:10.1.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:10.1.0
• octoperf/jmeter-webdriver:10.1.0

Bug Fixes

• Support expressions like ${__P(key,defaultValue)} in constant throughput thinktime (#828)
• UI: add Apply All button to Runtime Properties (#827)
• Report Templates: further filter specific report items / metrics which cannot be fitted into a template (#825)

10.1.0 (5th February 2019)

OctoPerf 10.1 introduces the following major improvements:

• Docker Private Registries: the backend can be configured to use a private registry to pull jmeter images,
• Remote Control: Define JMeter properties and remotely change those properties live while the test is running,
• Report Templates: create your own report templates!

Other changes are listed below.

Docker Images

• octoperf/docker-agent:10.1.0
• octoperf/enterprise-edition:10.1.0
• octoperf/enterprise-ui:10.1.0
• octoperf/enterprise-documentation:10.1.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:10.1.0
• octoperf/jmeter-webdriver:10.1.0

Bug Fixes

• Agent: upgrade may fail because containers list is not filtered properly (#824)
• Correlation Rules: Avoid duplicates when importing a framework several times (#823)
• Correlation Rules: .NET rules with overriden encoding are not working properly (#822)

Enhancements

• Docker: ability to configure a private Docker Registry (#820)
• Runtime: Remote Control JMeter Properties (#818)
• APM: Improve Instana Integration (#817)
• Remove Social Login from Saas platform (#816)
• Runtime: compute containers to run asynchronously (#814)
• Analysis: Automatically merge JTL files into a single file (#798)
• Analysis Report Templates (#474)

10.0.1 (29th January 2019)

This version fixes a regression which has been introduced in 10.0.0.

Docker Images

• octoperf/docker-agent:10.0.0
• octoperf/enterprise-edition:10.0.1
• octoperf/enterprise-ui:10.0.1
• octoperf/enterprise-documentation:10.0.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:10.0.1
• octoperf/jmeter-webdriver:10.0.1

Bug Fixes

• JMeter: CSV Splitter and Rendez-vous agents are not working (#812)

10.0.0 (28th January 2019)

OctoPerf 10 features the following major improvements:

• Upgrade from JDK 8 to Java JDK 11,
• Security: Backend, Agent and JMeter containers now running as non-privileged octoperf user,
• Monitoring: New-Relic APM is now supported,
• APM: Instana is now supported,
• Server Port: both internal and public port can now be configured.

Warning

OctoPerf EE 10.0.0 introduces breaking changes. make sure to read the Migration guide to upgrade from previous versions.

Docker Images

• octoperf/docker-agent:10.0.0
• octoperf/enterprise-edition:10.0.0
• octoperf/enterprise-ui:10.0.0
• octoperf/enterprise-documentation:10.0.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:10.0.0
• octoperf/jmeter-webdriver:10.0.0

Bug Fixes

• UI: Tree view displays invalid containers (#787)

Enhancements

• Cloud: add support for AWS eu-north-1 region (Stockholm) (#795)
• APM: add support for Instana (#809)
• JMeter: run as non-privileged octoperf user (#808)
• Upgrade codebase from Java JDK 8 to Java JDK 11 (#718)
• Agent: restrict internal SSH access to octoperf user (#805)
• JMeter Docker Image: change JMETER_DIR to JMETER_HOME (#806)
• Agent: --privileged is not required anymore (#804)
• Docker Images: Run as non-privileged user (#803)
• Monitoring: Add New-Relic APM monitoring (#799)
• Clustering: remove Apache Ignite driver (#802)
• Improve Correlation Rules algorithm (#801)
• Upgrade to Spring Boot 2.1.2.RELEASE (#786)
• JMeter: import RandomCSV DataSet as CSV with shuffled rows (#775)
• Upgrade various internal libraries (#796)

9.8.0 (8th January 2019)

Docker Images

• octoperf/docker-agent:9.8.0
• octoperf/enterprise-edition:9.8.0
• octoperf/enterprise-ui:9.8.0
• octoperf/enterprise-documentation:9.8.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:9.8.0
• octoperf/jmeter-webdriver:9.8.0

Bug Fixes

• UI: Entity tables sort on name / description is not refreshed (#793)
• Force content as UTF-8 in http requests (#792)
• Retrying scaling a test 1x time if waiting for machines for too long (#789)
• Make Agent communication fail-safe with retries on failure (#788)
• JMeter JMX: Import causes an NPE (#785)
• UI: Unpin Button is not working properly (#784)
• Agent: Upgrade can be stuck if multiple agents are running on the same machine (#782)

Enhancements

• Support before-test.sh and after-test.sh scripts before / after JMeter test run (#794)

9.7.0 (29th November 2018)

Docker Images

• octoperf/docker-agent:9.7.0
• octoperf/enterprise-edition:9.7.0
• octoperf/enterprise-ui:9.7.0
• octoperf/enterprise-documentation:9.7.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:9.5.0
• octoperf/jmeter-webdriver:9.5.0

Bug Fixes

• Agent: AgentFailure message incorrectly mapped to AgentMessage (#778)
• UI: Editing a delay doesn't work (#779)
• WebDriver: add delay on import to avoid slamming the CPU (#605)
• Top Throughput: exclude per second metrics (#771)
• Parallel Sampler: automatically switch PARENT_SAMPLE to false on import (#764)
• JMX Import: exclude Perfmon collector (#753)
• Results Tree display issues (#754)
• Agent: Timeout while pulling image (#773)

Enhancements

• Clustering: new ignite driver using Apache Ignite (#776)
• Report Exports: customizable logo and company name (#621)
• Reports Export: Configurable number of lines in tables (#622)
• Reports Export: landscape mode (#624)
• Hazelcast: Upgrade from 3.10.6 to 3.11 (#774)
• Agent monitoring: add CPU Idle counter (#772)
• Saas: add twitter feed to login page (#769)

9.6.1 (20th November 2018)

Docker Images

• octoperf/docker-agent:9.5.0
• octoperf/enterprise-edition:9.6.1
• octoperf/enterprise-ui:9.6.1
• octoperf/enterprise-documentation:9.6.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:9.5.0
• octoperf/jmeter-webdriver:9.5.0

Bug Fixes

• Test may fail to stop properly: JMeter lacks UDP max port (#768)
• Packer Manifest: properly parse DigitalOcean manifest when copying images during build (#767)
• JMX Import: when path is a variable, do not add leading slash (#762)
• VU Deletion: also delete check requests and responses (#681)

9.6.0 (19th November 2018)

Docker Images

• octoperf/docker-agent:9.5.0
• octoperf/enterprise-edition:9.6.0
• octoperf/enterprise-ui:9.6.0
• octoperf/enterprise-documentation:9.6.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:9.5.0
• octoperf/jmeter-webdriver:9.5.0

Enhancements

• Runtime: add Cookie Policies NETSCAPE and BESTMATCH policies (#765)
• Analysis: add filters to Result and Error Tables (#763)
• Design: add Download Resources filter and pool size configuration (#273)

9.5.0 (9th November 2018)

Docker Images

• octoperf/docker-agent:9.5.0
• octoperf/enterprise-edition:9.5.0
• octoperf/enterprise-ui:9.5.0
• octoperf/enterprise-documentation:9.5.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.3
• octoperf/jmeter-standard:9.5.0
• octoperf/jmeter-webdriver:9.5.0

Bug Fixes

• Agent upgrade may fail when container not found (#755)

Enhancements

• IP Spoofing: use multiple network interfaces / IPs to inject load (#760)
• UI: Reorganize Top Menu (#738)
• Elasticsearch 6.4.3 (#761)

9.4.2 (25th October 2018)

Docker Images

• octoperf/docker-agent:9.4.2
• octoperf/enterprise-edition:9.4.2
• octoperf/enterprise-ui:9.4.2
• octoperf/enterprise-documentation:9.4.2
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
• octoperf/jmeter-standard:9.4.2
• octoperf/jmeter-webdriver:9.4.2

Bug Fixes

• Enterprise-edition: password reset template mail is pointing to saas platform (#752)
• Multipart parameters with Filename as variable (${var}) not handled properly (#692)

Enhancements

• Proxy Settings: docker-agent now takes into account system proxy env variables (#750)

9.4.1 (17th October 2018)

Docker Images

• octoperf/docker-agent:9.2.2
• octoperf/enterprise-edition:9.4.1
• octoperf/enterprise-ui:9.4.1
• octoperf/enterprise-documentation:9.4.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.2
• octoperf/jmeter-standard:9.4.0
• octoperf/jmeter-webdriver:9.4.0

Bug Fixes

• HTTP 403 Access Denied when creating a workspace (#745)
• When using Medium instances on private AWS account, machine has not enough memory (#740)
• CSV files imported along with JMX are not properly linked to variables (#739)
• AppDynamics Header path is in reverse order (#748)

Enhancements

• Elasticsearch 6.4.2 (#747)
• UI: Display JSR223 script action args (#744)
• UI: Comparison Results list not displaying one report (#742)
• Mail: support much wider possible configurations (#690)

9.4.0 (25th September 2018)

Docker Images

• octoperf/docker-agent:9.2.2
• octoperf/enterprise-edition:9.4.0
• octoperf/enterprise-ui:9.4.0
• octoperf/enterprise-documentation:9.4.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.4.1
• octoperf/jmeter-standard:9.4.0
• octoperf/jmeter-webdriver:9.4.0

Bug Fixes

• UserLogin event must be only sent when login is successful (#736)
• Results Tree is not working properly with WebDriver virtual users (#733)

Enhancements

• Upgrade many internal libraries to latest version (#731)
• Upgrade to JMeter 5 (#730)
• Sanity Check: warn when Host header is different from server hostname (#700)
• Sanity Check: warn if a CSV file is empty or has no values (#478)
• Sanity Check: warn if think times are high (greater than 30sec) (#391)
• Refactor Virtual User creation wizard (#735)

9.3.0 (17th September 2018)

Docker Images

• octoperf/docker-agent:9.2.2
• octoperf/enterprise-edition:9.3.0
• octoperf/enterprise-ui:9.3.0
• octoperf/enterprise-documentation:9.3.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
• octoperf/jmeter-standard:9.2.2
• octoperf/jmeter-webdriver:9.2.2

Bug Fixes

• Results Sampling: increase sampling when load significantly increases (>=100k vus) (#725)
• Docker Batches: cleanup batches stuck in CREATED state (#722)
• Heavy Load Tests: Improve responsiveness and ingestion capacity (#721)
• UI: Runtime profile bug when adding point on crowded profile (#720)
• UI: Order Results table by increasing timestamp with millisecond precision (#714)
• JMX Import: LoopController.loops can be both stringProp and intProp (#711)
• UI: prevent switching from post body url-encoded to raw (#585)

Enhancements

• UI: Start OctoPerf on VU creation page (#724)
• CSVs: split CSV files only when enough values available (#719)
• Bench Errors: store 100 errors per container (previously 50) (#713)
• UI: inform user what's going to be deleted when deleting a workspace / project (#712)
• WebDriver: Use Google Chrome 68 instead of Firefox 47 (#710)
• Design: Support Http Request Names (#709)
• Log Agent IPs on test launch (#708)
• Reports: New Tree Table Report (#706)

9.2.2 (28th August 2018)

When upgrading to 9.2.2+, you will need to upgrade your on-premise agents to the latest version manually. Simply delete and re-create the container using the command-line provided from the UI.

Docker Images

• octoperf/docker-agent:9.2.2
• octoperf/enterprise-edition:9.2.2
• octoperf/enterprise-ui:9.2.2
• octoperf/enterprise-documentation:9.2.2
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
• octoperf/jmeter-standard:9.2.2
• octoperf/jmeter-webdriver:9.2.2

Bug Fixes

• Agent Upgrade is failing due to improperly mapped volumes (#704)
• Load Generator network monitoring stats are not working (#701)

Enhancements

• Add support for a remove-files.txt file to delete files from JMeter (#703)

9.2.1 (9th August 2018)

Docker Images

• octoperf/docker-agent:9.0.0
• octoperf/enterprise-edition:9.2.1
• octoperf/enterprise-ui:9.2.1
• octoperf/enterprise-documentation:9.2.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.2
• octoperf/jmeter-standard:9.2.1
• octoperf/jmeter-webdriver:9.2.1

Bug Fixes

• Unreachable Hosts should be rebooted after a cooldown period (#696)
• No m5.xlarge available in ap-southeast-1 (#694)
• Elasticsearch automated snapshots fails to delete old ones (#693)
• UI: wrong units displayed in graphs (#684)
• WebDriver: variables not detected when used in script parameters (#683)
• JMX Import: ignore WebDriver configurations (#682)

Enhancements

• JMeter Images: upgrade to Ubuntu 18.04LTS (#698)
• Performance: reduce number of http samples being sent (#697)
• Elasticsearch: automated snapshots through yml configuration (#687)

9.2.0 (12th July 2018)

Docker Images

• octoperf/docker-agent:9.0.0
• octoperf/enterprise-edition:9.2.0
• octoperf/enterprise-ui:9.2.0
• octoperf/enterprise-documentation:9.2.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.1
• octoperf/jmeter-standard:9.0.1
• octoperf/jmeter-webdriver:9.0.1

Bug Fixes

• CSV variables used in WebDriver parameters aren't exported in JMX (#680)
• CSV variables used in WebDriver scripts aren't exported in JMX (#679)
• files named with Uppercase chars could not be found during test (#674)
• JMX Import: Scripts at test plan level are not imported (#663)

Enhancements

• Upgrade to Elasticsearch 6.3.1 (#678)
• Add support for WebDriver parameters field (#675)
• Virtual user validation is updating live during the run (#672)
• Increase maximum settable memory by profile to 128MB (#667)
• AWS Provider: ability to configure memory, shutdown policy and cloud instances (#666)
• Cloud Providers: change zones from map to list to better support AWS Accounts with lots of VPCs (#662)

9.1.0 (2nd July 2018)

Docker Images

• octoperf/docker-agent:9.0.0
• octoperf/enterprise-edition:9.1.0
• octoperf/enterprise-ui:9.1.0
• octoperf/enterprise-documentation:9.1.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.3.0
• octoperf/jmeter-standard:9.0.1
• octoperf/jmeter-webdriver:9.0.1

Bug Fixes

• Only Private docker providers can be created (#657)
• Fix licences panel in UI (#654)
• Properly import JMX when Authentication Manager is empty (#651)

Enhancements

• Improve Guided Tour (#653)
• Automatically detect and downloading JMeter Plugins when importing JMX (#652)
• Upgrade various internal libraries (#647 and #648)
• Upgrade to Elasticsearch 6.3.0 (#644)
• Cloud Providers: Support AWS Elastic IPs and DigitalOcean Floating IPs (#635)

9.0.1 (18th June 2018)

Docker Images

• octoperf/docker-agent:9.0.0
• octoperf/enterprise-edition:9.0.1
• octoperf/enterprise-ui:9.0.1
• octoperf/enterprise-documentation:9.0.1
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
• octoperf/jmeter-standard:9.0.1
• octoperf/jmeter-webdriver:9.0.1

Bug Fixes

• JMX: Server is imported as https with port 80 (#646)
• ServerAgentService.isIdle should ignore Exited containers (#643)
• Stale Tests are not finished after xx minutes (#642)
• Windows process monitor 404 (#639)
• JMX Import Issue with Test Fragments (#633)
• Do not import headers starting with : (#630)
• JMeter script tries to send agent logs (#629)
• Disabled Agent Seen as Down (#628)
• Agent Randomly appears as disconnected when high-availability is enabled (#627)

Enhancements

• Upgrade various external libraries (#641)
• Improve Test Initialization logs (#632)

9.0.0 (1st June 2018)

Major change: As of 9.0.0 and above, Rancher is not used for load generators anymore.

Docker Images

• octoperf/docker-agent:9.0.0
• octoperf/enterprise-edition:9.0.0
• octoperf/enterprise-ui:9.0.0
• octoperf/enterprise-documentation:9.0.0
• docker.elastic.co/elasticsearch/elasticsearch-oss:6.2.4
• octoperf/jmeter-standard:9.0.0
• octoperf/jmeter-webdriver:9.0.0

Bug Fixes

• Importing Firefox 60 and above HAR could fail (#614)
• JMX Import was not properly importing timers (#619)
• Increase Extra Memory Percent to improve small machines usage (#620)

Enhancements

• Rancher is no longer required to run OctoPerf EE (#609)
• Scenario and Results views feature a World Map

8.3.0 (19th April 2018)

Bug Fixes

• Upgrade to Spring Boot 2, Elasticsearch 6.2.3 and other various libraries (#586)
• Parse ${__P(name,value)} variable on JMX import (#601)
• CSV File splitting is not working properly when column names inside as first line (#603)

8.2.0 (26th March 2018)

Enhancements

• Design: Correlation rules frameworks update (#590)
• Design: Virtual user validation now display 4XX+ on record as errors (#270)
• Design: Copy/ paste refactor (#558)
• Design: Autocompletion in server configuration (#562)
• Design: Pin Validate Virtual User panel if one is running when opening a VU (#570)
• Design: Sanity Check displays an error on query parameter with empty name and value (#550)
• Monitoring: Support Prometheus monitoring (#500)
• Runtime: Reduce default memory used by JMeter to download large files (#581)
• Runtime: Custom load policy (#556 and #587)
• Analysis: Add 99 percentile to result table (#566)
• UI: Documentation lazy loading (#557)
• UI: Update fontawesome to latest version (#547)

Bug Fixes

• JMX Import: Regexp Extractor with body unescaped should be imported as extractor on body (#580)
• Design: PUT request contains invalid chars in body (#582)
• Design: Selenium webdriver request tab not showing the URL accessed (#574)
• Design: PUT request body must be raw (Name/Value post parameters are ignored by JMeter in PUT / PATCH requests) (#573)
• Design: Https Server Port is 80 instead of 443 on JMX Import (#560)
• Design: Search and replace hangs (#565)
• Runtime: URL Parameter not encoded at replay by JMeter (#569)
• Runtime: M5.xlarge not available in all zones (#555)
• Runtime: JMX: If Controller is not properly configured (#561)
• Runtime: ThinktimeText is causing issues in JMX with DelayAction (#559)
• Analysis: Sent bytes always shows 0 in summary with containers (#567)
• Analysis: Result table sort on numeric values (#564)

8.1.0 (15th February 2018)

Enhancements

• Upgrade from Elasticsearch 6.1.2 to 6.2.1 (#545)
• Upgrade various internal libraries (#545 bis)
• Support variables in Thinktimes (#544)
• Upgrade from JMeter 3.3 to 4.0 (#546)
• Support JMeter LoopController (#526)
• UI: Improve Scenario Profile Edition (#539)
• UI: Automatically pin buttons when searching / running a validation (#537)
• UI: Improve test start time visibility (#532)
• UI: Replace Toaster warning messages by notifications (#531)
• UI: Update various dependencies (#531)
• UI: Allow child actions for JMeterAction (#527)
• UI: Improve Printable Test Report (#530)
• UI: Improve Results Trend Chart (#522)

Bug Fixes

• JMX Import: support HTTP Request Defaults with no port or scheme (#549)
• Fix: Post Parameters with only name have equals included (#543)
• JMX Import: Fix edge cases (#542)
• UI: Autosave may not kick in on page change (#535)
• UI: Fix a scrolling issue when viewing test reports (#528)
• Fix a possible NPE when importing HAR from latest Chrome version (#523)

8.0.1 (4th February 2018)

Enhancements

• UI: Confirm dialog before stopping the test (#513)
• UI: In monitoring, skip resources panel when none required by the monitor (#485)

Bug Fixes

• JMX Import: support JMX generated by third party tools like Taurus (#521)
• UI: Report summary has no scrollbar (#520)
• UI: Clear BenchInformationResource cache (#518)
• JMX Import: properly handle http request defaults port (#515)
• UI: Various small cosmetic issues (#514)

8.0.0 (12th January 2018)

Warning

Please carefully follow 7.5.x to 8.0.x Migration guide prior to upgrading to 8.0.x.

Enhancements

• Comparison: compare results across several test results
• Upgrade to Elasticsearch 6.1.1

7.5.2 (19th December 2017)

Bug Fixes

• Latest Chrome Browser HARs are imported in reversed chronological order (#499)

7.5.1 (6th December 2017)

Bug Fixes

• Plain Post Data Encoding in exported JMX is invalid in some cases (#492)
• Analysis Results Table column order is randomly changing (#486)

7.5.0 (28th November 2017)

Enhancements

• Single Sign-On (SSO): LDAP authentication (#351)
• Backend supports Startup Delay support in UserLoad in Scenarios (#477)

Bug Fixes

• JMeter JMX with WebDriver is not marked as WebDriver (#488)

7.4.1 (23th November 2017)

Bug Fixes

• Raw Post Body containing CRLF must be encoded properly in JMX (#483)
• CSV Variable Balancing may not work properly in some edge cases (#481)
• Http Server Authentication did not support absolute URLs (#480)
• User login must be case-insensitive (#467)

7.4.0 (17th November 2017)

Enhancements

• OctoPerf SLA : Service Level Agreement profiles are configurable in the Design / Monitoring and visible in the test reports.
• Load Injector monitoring : added threshold alarms when CPU usage is over 80%.
• HTTP Servers : Connection and Response Timeouts are now configurable per server.
• Correlation Rules Frameworks : updated the SAML and .Net frameworks.
• Virtual User Cleanup : when removing SLA profiles or HTTP Servers, empty containers are also removed.
• Report Trends : the analysis page show a trend graph if showing the response time and hits/errors counts for all selected reports.
• Frontend optimization : the design page and the search & replace for big Virtual Users (hundreds of actions) is now faster.
• HTTP headers auto-completion : common HTTP request actions header names are now suggested during edition.
• Test report summary : to quickly navigate in the report, a summary is displayed on the right.
• ElasticSearch upgrade to version 5.6.4.

Bug Fixes

• [Design] Correlation rules injections 'with name' field is left to an empty string when it is cleared.
• [Design] The displayed number of items currently in the trash is wrong after an action is dropped back into the Virtual User.
• [Design] JMX import may throw a ClassCastException.

7.3.4 (21th October 2017)

Bug Fixes

• [Design] HTTP Query Parameters with only name aren't within the JMX Script

7.3.3 (20th October 2017)

Bug Fixes

• [Monitoring] HTTP 400 Bad Request when listing Monitoring Agents

7.3.2 (19th October 2017)

Enhancements

• OctoPerf Catalog: configurable data volume mapping

Bug Fixes

• [Design] HAR Import: ignore query params with empty name and value bug design
• [Design] Bulk server deletion make encounter race condition
• [Design] Create Default Correlation Frameworks if none found

7.3.1 (18th October 2017)

Bug Fixes

• Jenkins JUnit Report were broken
• Monitoring fails with Http 503 error with restricted workspace rights
• Query parameters are always written in Path (JMeter JMX)
• HAR import: query parameters with only value are treated as name only
• Jenkins: Report link points to Saas when using Enterprise-Edition