FortiSIEM What’s new in Release 4.2.3

What’s new in Release 4.2.3

This release addresses several issues and enhancements on top of 4.2.2 release.

Note: To upgrade to this release, migrate to 4.2.1 first and then upgrade to 4.2.3. It is not possible to directly upgrade from 3.7.x or earlier releases to 4.2.2 because of the Linux Operating System changes.

The following are the key issues that are addressed in this release:

Bug 9211: Windows log and metric pulling via WMI has been optimized to be roughly 4x faster and more robust

Bug 11459: Checkpoint LEA log collection agent occasionally restarts

Bug 11631: VMware log pulling sometimes stops after encountering an exception in the API

Bug 11699: QueryMaster module memory grows to be large when there are over large number of devices (over 2500) in summary dashboard.

Other addressed issues include the following:

General GUI related fixes and enhancements

Bug 11353: App server stops picking discovery result xml files when malware site/IP auto update failed

Bug 11517: Windows server version in device selector UI can not be seen completely

Bug 11526: Delete custom event attribute or custom event type – the custom dashboard column not removed

Bug 11586: Footer shows wrong language when browser’s OS language is not in English

Bug 11654: Custom Property Attribute not populating in query conditions

Bug 11655: CMDB/Performance page shows CPU green at 100% utilization

Bug 11735: App Server Exception for incidents with custom event attribute causes performance issues

Platform related fixes and enhancements

Bug 11435: Handle error: “File does not exist: /var/www/html/favicon.ico”

Bug 11574: Include misc debugging tools: nfsiostat, iostat, screen, ntop

Bug 11812: Custom group is not editable after migration

Performance Monitoring / STM related fixes and enhancements

Bug 11336: Add sent bits/sec and received bits/sec to Netflow metrics

Bug 11410: Nessus vulnerability scanner reports are not parsed correctly

Bug 11422: Add “Diff” system transform for custom SNMP and WMI performance monitoring

Bug 11426: Possible memory leak issue in VMware performance pulling agent

Bug 11428: Add use cases for Linux syslog monitoring – detect “yum update”, system going down, network interface up/down, process killed by kernel because of out of memory

Bug 11449: The NMAP check during Flow based service detection can cause unnecessary probing traffic from AccelOps. Remove the nmap test or make it optional.

Bug 11450: VMware monitoring enhancements:

Add Cluster names and VCenter IP to all VMware host events

Add Folder to show VM performance metrics on the right hand side in VMware view

Add folder information to VMware guest and ESX events

Capture VMware tools version including it is out of date or not Add cluster balance information

Bug 11470: Exclude Mounted Volumes from disk space monitoring at client machine. The mounted volume disk space has to be monitored at the server side.

Bug 11620: Some interfaces (like Serial) have send/recv bytes only from regular IF-MIB and not from high speed MIB; so need to pick interface speed from regular IF-MIB and not from high speed MIB. Currently speed for T1 interfaces is picked from high speed MIB and so it is 2Mbps instead of 1536Mbps.

Rule / Query / Report Engine related fixes and enhancements

Bug 10934: The rule “Concurrent VPN Authentications To Same Account From Different Cities” need to be enhanced to cover the case where user attribute is not present in the log.

Bug 11360: Some pre-defined rules does not map Reporting IP to Destination IP in incident events – this may cause notification policy to trigger

Bug 11456: Include Reporting IP for consideration in Notification policy > Affected Objects. Currently Affected Object check includes only Destination IP and Host IP.

Bug 11483: Rule synch – new worker causes performance  issues

Bug 11594: Should restart phRuleMaster when failed to retrieve rule exception

Bug 11775: Incident fails to trigger when host name contains special characters which are not acceptable in XML e.g. &, <, > etc

Parsing related fixes and enhancements

Bug 10418: User name in Windows MSSQL Server Event 18453 is not parsed

Bug 11230: Certificate Information in Win-Security-4768 and Win-Security-4771 not parsed

Bug 11239: Event time order not always maintained at the Supervisor/Worker nodes

Bug 11280: FortiGate event “FortiGate-traffic-icmp-allowed” is improperly classified as a denied event and triggers rules

Bug 11466: Several events are not parsed for Barracuda Mail gateway

Bug 11473: If parser sets event severity, then let it win over event severity from syslog header

Bug 11615: Juniper SSL VPN parsing extensions

Bug 11634: User not parsed in Windows Security 4625 events

Bug 11696: For Cisco ASA, Network Interface > Security Level info not consistently propagated to parser – this causes problems in identifying source and destination interfaces for parsing network traffic

Discovery related fixes and enhancements

Bug 11260: CBQoS / BGP / OSPF metrics get falsely discovered for Cisco devices even when they are not configured on the device

Bug 11397: Allow HTTPS selection choice for NetApp ONTAPI discovery

Bug 11519: Update access IP after re-discovery if original access IP interface is down

Bug 11524: Handle “>” as prompt in Unix SSH scripts

Bug 11582: EMC VNX CPU Discovery fails with password special characters

Bug 11681: EMC VNX discovery fails when it has only Meta LUNs but no normal LUNs

Bug 11755: VMware VCenter 5.5 discovery cannot return the correct tree structure when a Data Center is created under a Folder

Device Support

Bug 11419: VMware VCNS log parsing

Bug 11474: Collect Back-to-back consistency point metric for NetApp from SNMP

Bug 11539: Support for Emerging Threats Snort rules

Bug 11553: Match Cisco MARS SIM rules

Bug 11559: NeXpose Rapid7 XML Export 2.0 Report format not supported

Bug 11570: Support FireEye HX appliance

Bug 11616: IronPort-Web Parser Logic Error

Bug 11680: Parse additional foundry syslog

Bug 11697: Add user name and source IP addr from ASA-113019 into identity and location report

Bug 11722: User information in Spanish win-security-4625 cannot be parsed correctly

Bug 11727: Update Cisco IPS Signatures to latest

Bug 11732: Windows events 673, 4769, 4773, 674, 677, 4770 are assigned to wrong log failure group causing brute force logon rules to fire

Bug 11733: Windows Clustering Failover rule definition needs to be tightened by adding  the constraint eventSource = “Microsoft-Windows-FailoverClustering”

FortiSIEM What’s New in Release 4.3.1

What’s New in Release 4.3.1

This release adds features and functionality in several areas.

AccelOps Visual Analytics

AccelOps Systems Features

New chart types for search result visualization

Visualization for profiled metrics and drill down from incidents

Performance and Availability Monitoring

Ability to specify per-device threshold in rules

Enhanced custom command output monitoring

Windows custom command output monitoring

Log Management and Security Incident Event Monitoring (SIEM)

Amazon Web Services CloudTrail monitoring

Box.com file monitoring

Okta Single Sign-On (SSO) integration via SAML 2.0

Vendor default password usage detection

Detect malware via file hash and user agent match

Detect communication via Anonymity Networks (Open Proxies and TOR nodes)

Device Support

Significant Enhancements

Migrate SVN to local disk

Trigger event query optimization

Device location import

Event dropping rule enhancement

CIDR format for specifying discovery ranges

Launch discovery from CMDB

IP Address management enhancements

Critical interface selection usability enhancement

CMDB Report extensions

Dynamic EPS Adjustment algorithm

Incident table and Identity/Location table partitioning

Paged control support for Microsoft Active Directory LDAP discovery

Events when device performance monitoring status changes

Enhanced custom parser development graphical user interface

Fixed Issues and Minor Enhancements

General GUI

Platform

Performance Monitoring / Event Pulling / Synthetic Transaction Monitoring (STM)

Rule / Query / Report Engine

Discovery

Device Support

Parsing  area

Data: System Rules/Reports

 

 

New Product

AccelOps Visual Analytics

This release enables AccelOps data to be visualized using Tableau Visual Analytics and Visual Analytics Desktop in conjunction with the AccelOps Report Server. Two kinds of AccelOps data can be visualized:

Data residing in Configuration Management Database (CMDB) e.g. Incidents, Device attributes

Any event database report result as long as it contains an aggregation condition e.g. GROUP BY

You can find full information in the Visual Analytics section of this wiki.

AccelOps Systems Features

New chart types for search result visualization

This release enables users to visualize query results within AccelOps using scatter plots, bubble charts, tree maps and heat maps. This complements existing visualization via pie charts, bar charts, trend charts, and geo maps. Scatter plots enable users to see correlations between any pair of calculated measures (e.g. CPU and memory utilization, Sent and received bytes etc). Bubble charts add a third dimension to scatter plots to reflect the size of the added dimension, e.g. in a scatter plot containing CPU and memory utilization as the two dimensions, the third dimension could be total sent and received bits/sec. The tree map is a hierarchical tree-structured visualization that is often used to analyze dominating components of multidimensional data e.g. IPS signatures, network traffic etc. Heat maps show the calculated measure for two dimensions using a color grade that helps users to understand severity. These charts are available both in Analytics and Dashboard areas.

This topic is discussed here.

Visualization for profiled metrics and drill down from incidents

AccelOps creates statistical baselines (profiles) for a large number of use cases. While earlier releases showed this information in tabular form, this data can now be visualized. For a specific dimension (such as host), up to four measures can be visualized on a trending hour-by-hour basis for weekdays and weekends as a multi-series column chart. In general, the profiles can be visualized as a scatter plot. From an incident indicating excessive deviation from statistical measures, it is now possible to drill down into the baseline with one click.

This topic is discussed here.

Performance and Availability Monitoring

Ability to specify per-device threshold in rules

AccelOps has rules that trigger when certain thresholds are crossed. When the thresholds have to be fine-tuned on a per-device basis, rule conditions become complex and difficult to manage. This release solves this issue. Instead of explicit threshold values in rules, the thresholds are now defined as custom properties in which the user can choose to override the global thresholds by redefining the thresholds locally for a certain set of devices. Instead of hard-coding thresholds, rules are now written using a function that returns the appropriate values – local values if one is defined, global values otherwise. This approach keeps the number of rules the same, but allows users to set thresholds for any number of devices. Thresholds can be a simple number (e.g. CPU utilization) or a map (e.g. interface utilization for each interface, disk utilization for one or more disks).

This topic is covered here (see the section: “Thresholds as Custom Properties”).

Enhanced custom command output monitoring

This release enhances the way custom performance monitor command outputs are parsed into events. Prior to release 4.3.1, command outputs are parsed as one line into one event. This does not include, for example, “show version” commands for Cisco IOS routers that can span multiple lines. Release 4.3.1 improves this situation – multiple lines can be parsed into one event.

This topic is covered here.

Windows custom command output monitoring

A Windows custom performance monitor can be used to bring PowerShell command outputs into AccelOps. Prior to release 4.3.1, command output was obtained via Telnet/SSH, but that is not natural for Windows, and the user had to install Cygwin Telnet/SSH in Windows systems. This release enhances the situation by using winexe client on AccelOps – any Windows shell commands, such as PowerShell, can be remotely run on Windows servers using WMI credentials. There is no need to install any software on Windows. Additionally, multi-line command outputs can be parsed into one event in AccelOps. This enhancement now enables customers to run PowerShell commands in Windows servers.

This topic is covered here.

Log Management and Security Incident Event Monitoring (SIEM)

Amazon Web Services CloudTrail monitoring

As more and more applications are deployed in the Cloud, monitoring user activity in the cloud is becoming increasingly important. For example, it is important to know when users are created, permissions are changed, virtual machines are spun up, network configurations are changed, or Virtual Private Clouds (VPCs) are created. This release enables AccelOps to efficiently collect, parse, report, and alert on Amazon Web Services activity via the AWS CloudTrail API.

This topic is discussed here.

Box.com file monitoring

Box.com is a cloud storage provider that is used by individuals as well as corporations to store and share files. This release enables AccelOps to monitor file activity within a Box.com account. AccelOps securely logs on to the Box.com account and monitors file creation, deletion, and modification activity within the account. More interestingly, for a specific file or all files in a folder, AccelOps can monitor file-sharing properties – is the file shared, is it password protected, is it preview/download enabled, and how many times was the file downloaded or viewed. If a particular file or directory contains confidential information, AccelOps can alert when any file in that directory was exposed to the outside or was viewed.

This topic is discussed here.

Okta Single Sign-On (SSO) integration via SAML 2.0

Oka is a cloud-based Single Sign-on (SSO) Service provider. This release enables AccelOps customers who are already authenticated in Okta to automatically log in to AccelOps without entering any credentials. AccelOps communicates via SAML 2.0 with Okta to verify user identity. In addition, AccelOps discovers all users defined in Okta (like Microsoft Active Directory) – the discovered users can be used in rule and report conditions and in notification policies. Finally, AccelOps collects Okta audit trails that can detect activity on the Okta web site such as account changes, logon activity, and other configuration changes.

This topic is discussed here.

Vendor default password usage detection

A common compliance requirement is to alert against the use of default vendor-defined credentials. This release enables AccelOps users to satisfy this requirement. AccelOps comes pre-built with a set of vendor and device specific default passwords. Users can add to this list.

Whenever a device discovery succeeds with a credential from this list, an alert triggers.

This topic is discussed here.

Detect malware via file hash and user agent match

This release comes with a set of built-in well-known malware user agents and malware file hash signatures. Users can also import their own lists from outside sources. Since malware is known to use non-standard http user agents, AccelOps alerts when it sees a malware user agent, regular expression-based match from web server or web-proxy logs. If AccelOps is configured for file integrity monitoring, then it can alert when it detects a malicious file hash match in a monitored directory.

Malware hash  is discussed here.

User agent is discussed here.

Detect communication via Anonymity Networks (Open Proxies and TOR nodes)

A compromised host or a user with malicious intent uses various techniques to hide their identity, with two common examples being proxies and TOR networks. This release comes with a set of built in well-known proxies and TOR networks. Users can also import their own lists from outside sources. Whenever AccelOps sees an IP address match from firewall logs or Netflow, an alert is created.

This topic is discussed here.

Device Support

Cisco VoIP infrastructure monitoring – see here

Cisco VoIP phone discovery from Cisco Call Manager via SNMP

Cisco Unity Connection – discovery and performance monitoring via SNMP

Cisco Presence Server – discovery and performance monitoring via SNMP

Cisco Contact Center – discovery and performance monitoring via SNMP

Cisco Tandeberg VCS – discovery and performance monitoring via SNMP

Cisco Telepresence MCU – discovery and performance monitoring via SNMP

More detailed performance monitoring of Cisco Call Manager – SIP Trunk Status, Gateway Status, H323 Device Status, Voice mail Server Status, CTI Device Status, Media Device Status

Parse 1000+ syslog messages from Cisco Call Manager and RTMT and create rules corresponding to RTMT Alerts

Oracle ACME Packet Controller – discovery and performance monitoring via SNMP

Brocade SAN Switch – discovery and performance monitoring via SNMP

Dell Force10 Switch – discovery and performance monitoring via SNMP – see here

Dell PowerConnect switches – discovery and performance monitoring via SNMP – see here

Nimble Storage – discovery and performance monitoring via SNMP

Cisco WAPX WLAN Controllers – discovery and performance monitoring via SNMP

MS SQL Server 2014 – discovery, performance monitoring, audit log  collection via SNMP, WMI, JDBC Oracle Audit log parsing via syslog

Wireless LAN Controller “module” on Fortinet firewalls. TrippLite Environmental Monitors

IBM WebSphere monitoring via HTTP(S) instead of JMX – see here

Arista switches and routers – discovery and performance monitoring via SNMP – see here VMware vShield – log parsing via syslog

Significant Enhancements

Migrate SVN to local disk

AccelOps uses SVN to store device configuration data and installed software information. Over time, this repository can grow and contain a very large number of files. Earlier releases hosted SVN over NFS, and network performance could become an issue over time. Since all accesses to SVN are via the Supervisor node, this release moves SVN to a Supervisor local disk on a separate logical drive. Fresh AccelOps 4.3.1 install automatically create a separate partition for storing SVN files. During AccelOps 4.3.1 upgrade process, a special pre-upgrade step is invoked to copy the SVN files over NFS to local disk. Actual upgrade does not begin unless existing SVN data has been copied over to the new disk – so the system continues to work during the pre-upgrade process.

Trigger event query optimization

Incidents are triggered by defined trigger events. When a user browses an incident in the graphical user interface, trigger events are shown, and incident notification emails can contain up to 10 trigger events. However, the AccelOps rule engine does not store raw events in memory, but only event identifiers, in an attempt to save memory. This means trigger events have to be retrieved from the event database by querying the event database. This query can be very expensive if the event is current, since the event may not have been indexed yet. This has been seen to create significant pressure on the AccelOps I/O system, especially if there is a sudden surge of incidents. This release addresses this issue by using an in-memory cache of raw messages for a short period of time.

Device location import

CMDB devices typically belong to private address spaces and their location is only known to the system administrators. There is now an easy way to input this information into AccelOps. Users can define locations by IP range or sub-net, and the location in CMDB will be instantly updated. The locations can be input manually via the graphical user interface, or imported from a file. In addition, devices can be searched by location in both the summary dashboard and CMDB.

This topic is discussed here.

Event dropping rule enhancement

Devices are often chatty and send all kinds of uninteresting logs to AccelOps. Since online storage is expensive, it is often necessary to be able to efficiently drop events before they are processed or stored. This release enhances event dropping rule framework by:

Including Source IP and Destination IP into the event dropping rule definition criteria

Allowing two different actions: drop completely, or store but do not trigger rules

Allowing the ability to automatically create drop rules from incidents in case the incident is a false positive, which is common in Network IPS event correlation scenarios

This topic is discussed here.

CIDR format for specifying discovery ranges

The test connectivity and discovery IP ranges can now be specified in CIDR notion as well.

Launch discovery from CMDB

Rediscovery can be directly launched from the CMDB page.

IP Address management enhancements

When allocating new addresses to hosts, it is often important to know the hosts that currently are assigned to addresses in a specific network segment. In prior releases, AccelOps discovered the network segments and showed only CMDB devices in that network segment. These do not include user devices such as laptops, workstations, mobile devices etc., since these devices do not necessarily belong in CMDB. Starting with this release, the Network Segment page also shows the hosts in the Identity and Location page belonging to the same network segment. Since AccelOps accurately learns all the IP addresses in a network via DHCP and IP ARP cache scan, administrators can correctly see every active host belonging to a specific network segment.

This topic is discussed here.

Critical interface selection usability enhancement

AccelOps allows users to mark interfaces as critical, and such interfaces are always monitored for utilization and up/down status. A common example is switch trunk ports, since a trunk port going down can cause a widespread network outage. Currently there is no easy way in AccelOps to select the trunk ports of all switches. Instead, the user has to traverse every switch and select trunk ports within that switch, which can be very tedious for a large network containing a large number of switches. This release provides a flattened view of the network interfaces so that a user can quickly select a large number of interfaces matching some search criteria. This enables administrators to mark all critical interfaces for a large network with only a few clicks.

This topic is discussed here.

CMDB Report extensions

CMDB Reports are extended to include

Successful Performance Monitor Reports

Failed Performance Monitor Reports

Identity and Location Report

Scheduled Report

Devices not updated in last N days

Dynamic EPS Adjustment algorithm

AccelOps has an algorithm to re-distribute unused EPS at a collector to other collectors seeing an event spike. The algorithm is now adjusted to have the following property: A collector is now always guaranteed to have the events-per-second specified as “Guaranteed EPS.” This EPS is never redistributed to other collectors. Only the excess EPS (defined as Overall EPS license minus the sum of all Guaranteed EPS) is redistributed on demand.

Incident table and Identity/Location table partitioning

In AccelOps CMDB, there are two tables that grow with time:

Incident table

Identity/Location table

The incident table grows as new incidents are created, while the Identity/Location table grows as new computers and users appear in the system or change location. As these tables grow, eventually the database may become full and read performance may suffer with corresponding growth in the table indices. In this release the following enhancements are made:

Incident Table Optimization:

The incident table is partitioned by month, so recent queries access the current month and result in fast returns During migration to 4.3.1 release:

Data for the last three months is migrated to the new tables (based on Last Seen Time field)

All ‘Active’ incidents are migrated

Older incidents are archived. Scripts are provided for customer to migrate older incidents into 4.3.1 CMDB. Scripts are provided to purge older incidents from 4.3.1 CMDB

Identity/Location Table Optimization:

The Identity/Location table is partitioned by month, so recent queries access the current month and result in fast returns During migration to 4.3.1 release:

Data for the last three months is migrated to the new tables (based on Last Seen Time field)

Older entries are archived. Scripts are provided for customer to migrate older identity/location entries into 4.3.1 CMDB. Scripts are provided to purge older identity/location entries from 4.3.1 CMDB

Paged control support for Microsoft Active Directory LDAP discovery

AccelOps discovers users in Microsoft Active Directory via LDAP protocol. By default, Microsoft LDAP search queries return up to 1000 entries per call (MaxPageSize limit – see Microsoft KB article). Earlier AccelOps releases required administrators to increase the MaxPageSize limit to a much higher number for user discoveries to work. This is generally inconvenient and may also cause resource issues on the server. This release enhances this situation. AccelOps LDAP discovery now uses the paged control version of the LDAP search API to fetch an arbitrarily large number of entries – 1000 at a time. Administrators are not required to increase the MaxPageSize limit beyond the default 1000.

Events when device performance monitoring status changes

AccelOps now generates audit events when the performance monitoring status of a job changes.

  1. User deleted a device or a collector:

<174>Nov 05 09:52:07

[PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[phEventCategory]=2

,[srcIpAddr]=192.168.20.164,[phCustId]=1,[sessionId]=11178d2aeae08e

9c2babe2725fa1,[procName]=AppServer,[hostName]=HQ-A-Pxy-blueCoat,

[hostIpAddr]=172.16.0.141, [eventSeverity]=PHL_INFO,[customer]=Super,[jobStatusType]=UserDelet edDevice,[user]=admin, [phLogDetail]=Monitors on device were deleted due to device being deleted

  1. User disabled monitoring at a device level:

 

<174>Nov 05 09:53:58

[PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[phEventCategory]=2

,[srcIpAddr]=192.168.20.164,[phCustId]=1,[sessionId]=11178d2aeae08e

9c2babe2725fa1,[procName]=AppServer,[hostName]=ACCELOPS-W2K3B4, [hostIpAddr]=192.168.64.124,[eventSeverity]=PHL_INFO,[custName]=Sup er,[jobStatusType]=UserDisabledDevice,[user]=admin, [phLogDetail]=Monitoring device, 192.168.64.124, is  disabled by user

  1. User enabled monitoring at a device level:

<174>Nov 05 09:54:38

[PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[phEventCategory]=2

,[srcIpAddr]=192.168.20.164,[phCustId]=1,[sessionId]=11178d2aeae08e

9c2babe2725fa1,[procName]=AppServer,[hostName]=ACCELOPS-W2K3B4, [hostIpAddr]=192.168.64.124,[eventSeverity]=PHL_INFO,[custName]=Sup er,[jobStatusType]=UserEnabledDevice,[user]=admin,[phLogDetail]=Mon itoring device, 192.168.64.124, is enabled by user

  1. User disabled a specific job:

<174>Nov 05 09:55:17

[PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[phEventCategory]=2 ,[phCustId]=1,[customer]=Super,[jobName]=System cpu usage,[srcIpAddr]=192.168.20.164,[appTransportProto]=SNMP,[sessionI d]=11178d2aeae08e9c2babe2725fa1,[procName]=AppServer,[hostIpAddr]=1 92.168.64.124,[hostName]=ACCELOPS-W2K3B4,

[eventSeverity]=PHL_INFO,[jobStatusType]=UserDisabledJob,[user]=adm in,[pullInteval]=180,[phLogDetail]=Protocol to monitor is disabled

  1. User enabled a specific job:

<174>Nov 05 09:55:59

[PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[phEventCategory]=2

,[phCustId]=1,[customer]=Super,[jobName]=System cpu usage,

[srcIpAddr]=192.168.20.164,[appTransportProto]=SNMP,[sessionId]=111

78d2aeae08e9c2babe2725fa1,[procName]=AppServer,[hostIpAddr]=192.168

.64.124,[hostName]=ACCELOPS-W2K3B4, [eventSeverity]=PHL_INFO,[jobStatusType]=UserEnabledJob,[user]=admi n,[pullInteval]=180,[phLogDetail]=Protocol to monitor is enabled

  1. User changed job polling interval:

<174>Nov 05 09:57:21

[PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[phEventCategory]=2

,[phCustId]=1,[customer]=Super,[jobName]=System real memory usage,

[srcIpAddr]=192.168.20.164,[appTransportProto]=SNMP,[sessionId]=111

78d2aeae08e9c2babe2725fa1,[procName]=AppServer,[hostIpAddr]=192.168 .64.124,[hostName]=ACCELOPS-W2K3B4,[eventSeverity]=PHL_INFO,[jobSta tusType]=UserChangedPollIntv,[user]=admin,[pullInteval]=300,[phLogD etail]=Interval of protocol to monitor is changed

<174>Nov 05 10:33:01

[PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[errReason]=Missing

/Invalid WMI credential for 192.168.20.207, PROC_RESOURCE, [phEventCategory]=2,[phCustId]=1,[jobId]=1545818,[customer]=Super,[ jobName]=Process Resource Usage via WMI, [srcIpAddr]=192.168.64.153,[appTransportProto]=WMI,[sessionId]=13b3 48ad44270e0249eafc9dfdc5,[procName]=AppServer,[hostIpAddr]=192.168.

20.207,[hostName]=win-li5sipp8s7s.accelops.net,[eventSeverity]=PHL_

INFO,[jobStatusType]=DiscoveryNotScheduled,[user]=1,[pullInteval]=1

80,[phLogDetail]=Monitor on device is not scheduled

  1. Successful job:

<174>Nov 05 10:13:00 [PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[errReason]=,[phEve ntCategory]=2,[phCustId]=1,[jobId]=1536112,[customer]=Super,[jobNam e]=Process Resource usage via SNMP,[srcIpAddr]=192.168.64.153,[appTransportProto]=SNMP,[sessionId

]=128e159a35b9f0f4cd71ca80222b,[procName]=AppServer,[hostIpAddr]=19

2.168.20.170,[hostName]=qa-win2008-217.accelops.net,[eventSeverity]

=PHL_INFO,[jobStatusType]=ExecutionSuccess,[user]=1,[pullInteval]=1

20,[phLogDetail]=Status of monitor is changed by Job

  1. Failed job:

<174>Nov 05 10:15:00 [PH_AUDIT_DEV_MON_JOB_STATUS_CHANGE]:[custId]=1,[errReason]=Failed to get process utilization in

executeGeneralProcResourceJobOpt,[phEventCategory]=2,[phCustId]=1,[ jobId]=1536112,[customer]=Super,[jobName]=Process Resource usage via SNMP, [srcIpAddr]=192.168.64.153,[appTransportProto]=SNMP,[sessionId]=12a b68da5ca2cceab2a69cbda16e,[procName]=AppServer,[hostIpAddr]=192.168 .20.170,[hostName]=qa-win2008-217.accelops.net,[eventSeverity]=PHL_ INFO,[jobStatusType]=ExecutionFailed,[user]=1,[pullInteval]=120,[ph

LogDetail]=Monitoring device failed

  1. Job stays in “Discovered Added” state for more than 15 minutes and is not scheduled:

<174>Nov 05 10:55:57 [PH_AUDIT_DEV_MON_JOB_NOT_STARTED]:[custId]=1,[phEventCategory]=2,[ phCustId]=1,[customer]=Super,[jobName]=ICMP Ping Status,[appTransportProto]=PING,[procName]=AppServer,[hostIpAddr]=1

72.16.10.110,[hostName]=HOST-172.16.10.110,[eventSeverity]=PHL_INFO

,[jobStatusType]=DiscoveryAdded,[user]=SYSTEM(phDiscovery),[pullInt eval]=120,[phLogDetail]=Monitoring job did not start yet

Enhanced custom parser development graphical user interface

The custom parser development graphical user interface is enhanced to include the following:

  1. Ability to search text within the XML file.
  2. Add a line number in the XML file. When there is a Error in ‘Validate’ or ‘Test’, show the line number as a reference to help user fix the problem.
  3. Allow user to reformat the text after block update for easy readability.
  4. Allow an option to Clear XML in one shot to allow for bulk replace.
  5. Color code the XML tags and text for easy readability.
  6. Show the parsed fields in Test results in a nice tabular form.
  7. Improve the scrolling/editing response for large XML files.
  8. Show the XML in a tree form – allow cross-linking of the XML Tree and the text edit window.
  9. Allow user to increase the size of the edit window.

Fixed Issues and Minor Enhancements

General GUI

Bug 7489: Created a CMDB report named “Active Dependent Rules” that tracks which rules depend on other rules. This helps users to tweak/enable/disable chained system rules

Bug 8021: Added indices in ph_task and ph_alter tables in PostgreSQL – this improves the GUI experience when user visits Alert and

Task tabs

Bug 8054: Allow an option to search on ‘Origin’ field in every tab in Admin > Device Support area. This allows users to quickly see user defined Device/Application types, Event Types, Event Attribute Types, Parsers and Dashboard columns

Bug 8165: Show VLAN as a column in Analytics > Identity and Location Report

Bug 8181: Need to get result of scheduled report even if the report has no data

Bug 8291: Allow user to unlock an AccelOps account

Bug 8896: Allow scheduled reports to skip charts and only contain tables

Bug 9266: Added “errReason” attribute to system event PH_REPORT_ACTION_STATUS – the attribute states why notification failed

Bug 9670: CMDB Device shows under Scheduled Maintenance even after device removed from Schedule Maintenance Calendar

Bug 9900: Expose Last Updated Time and Discover Method fields of a device for use in CMDB reports

Bug 10083: Display a warning when user disables or deletes a rule that is referenced in other rules

Bug 10172: Change the AccelOps GUI CMDB > Users so that all locally created users cannot edit the “domain” field

Bug 10198: Removal of devices or organizations from CMDB sometimes display foreign key violation errors

Bug 10250: Remove “Show Password” check box for credential

Bug 10382: enhancement:  allow HTML tags in custom e-mail templates

Bug 10394: Allow bulk disabling for blocked IP in the CMDB through the GUI

Bug 10450: Add ‘Apply To’ option to facilitate applying multiple authentication profiles to one or more users

Bug 10563: Add an Export button for Related Incidents screen

Bug 10830: Add locations view in summary dashboard

Bug 11343: Long device names truncated on Widget dashboard

Bug 11371: Allow import/ export of user defined watch list

Bug 11498: A rule with CLEAR conditions becomes invalid after clone process – constraints between main and clear rules are not properly copied over

Bug 11508: Ability to set locations for a large number of devices in  one shot

Bug 11596: Ability to add Notes to Rule exceptions. One should also be report on Rule exceptions.

Bug 11597: Add Remediation section to Rule definition. Add this to default email template. Make this part of CMDB report. Add this to custom notification template.

Bug 12583: User can not manually add important processes that have the same name but different process parameters

Bug 12613: Columns on Amazon EC2 performance view should be same as EC2 dashboard

Bug 12694: Provide an option to not have charts in exported PDF reports

Bug 12698: Enable search on “Monitor Errors” and “Error Description” on Admin > Setup wizard > Monitor Change/Performance > Monitor Errors popup

Bug 12760: Edit a Report Schedule and the Report automatically Runs

Bug 12786: Make error message clearer for event dropping rule creation on grouped incidents

Platform

Bug 9518: Glassfish log rotation is now configured for saving space – only keep 20 files and each of them max-sized 2000000 bytes.

Bug 9828: EPS Pulling functionality has limitations that lead to dropping of events by collectors

Bug 9938: Allow modular ‘yum upgrades’ for non-base-CentOS packages like JVM, Chrome, PostgreSQL, Glassfish

Bug 10144: Do not overwrite customer’s ssl.conf during upgrade

Bug 11926: DNS caching code has performance issues

Bug 12130: AccelOps uses rsyslog to receive our internally generated events. There is a throttle defined there (200 messages in 5 minutes interval). This will result message loss in high throughput situation like VoIP phone discovery, Layer 2 port mapping discovery etc. This throttle is removed since this is intra-computer communication and can handle much higher message rates.

Bug 12538: Detailed events, rules and reports for performance monitoring status changes

Bug 12584: Collectors sometimes fail to negotiate HTTP(S) connection to Super/Worker if ever they choose SSLV3 (because of poodle vulnerability – possibly because of a man-in-the-middle device like a IPS or a firewall disallowing all SSLV3 negotiations.

Bug 12585:The phMonitor module crashes when it sees a 3.7.6’s rest_cache_api list entry in phoenix_config.txt

Bug 12586: The configuration file phoenix_config.txt needs to be upgraded properly by maintaining user’s changes from previous versions

Bug 12644: Run script notification may fail if the raw message contains special XML characters

Bug 12649: Updating Dynamic Watch List by incidents causes Application Server to run out of memory when there are many many-to-many relationships between incidents and dynamic watch lists

Bug 12650: Full VM build does not ‘yum update’ packages as previously designed

Performance Monitoring / Event Pulling / Synthetic Transaction Monitoring (STM)

Bug 9848: Packet transmission timeouts for SNMP v1 and v2 phoenix_config needs to be extended from 1 minute to 5 minutes

Bug 11423: Add Custom command output monitoring via winexe for windows environments

Bug 12066: Parse CVSS_BASE score for vulnerabilities into (vulnCvssBaseScore attribute)

Bug 12213: Cisco IOS CPU can not be monitored in some cases with multiple CPUs – performance monitoring has to identify the control plane cpus

Bug 12214: PerfMonitor module will stop sending PH_DEV_MON_PING_STAT events for a gateway if its immediate down steam device are down

Bug 12387: NexPose vulnerability report XML parsing takes a long time

Bug 12458: Checkpoint needs a resume event handler

Bug 12561: Discovery never removes a PING job even if the device is not reachable by PING during discovery. This is done since a

PING is fundamental for measuring up time. Only a user can manually disable PING jobs

Bug 12601: Admin > Setup wizard > Monitor Change/Performance tab does not reflect the status of successful discovery after correcting device credentials.

Bug 12604: Events are not picked up by parser module if Supervisor node is down for an extended period of time

Bug 12625: For Qualys Vulnerability Scanner, Test connectivity succeeds, but the discover method and event pull methods are not set in discovery, resulting in no job creation for Java agent.

Bug 12661: Don’t trigger config change while getting config error

Bug 12730: Allow pulling interval to be less than 1 minute to pull windows logs at a faster rate. Added a phoenix config entry of

“wmi_pull_interval_scale” that can have a range from 1 (default) to 10. If users want to have a shorter interval for WMI event pulling, they can change it to 6 to make it 6 times faster; if the pulling interval in GUI is 1 minute, then events are pulled every 10 seconds.

Bug 12754: Enhance custom command output monitoring to generate an event to indicate no matching lines for regular expression. This can be used to detect e.g. a process is down from running the top command. If the regular custom command output monitoring command is PH_DEV_MON_CUST_DF then AccelOps would generate PH_DEV_MON_CUST_DF_NOT_FOUND when the are no matching lines in the command output

Bug 12787: Enhance performance monitoring status job upload to keep uploading if failed last time

Bug 12801: Custom command output monitoring – deleted items are still monitored

Bug 12803: Custom SNMP job monitoring sometimes fails to distinguish when one key is a prefix of the other; e.g.

SNMPv2-SMI::enterprises.9.9.48.1.1.1.5.1 from SNMPv2-SMI::enterprises.9.9.48.1.1.1.5.16. So the obtained value for

SNMPv2-SMI::enterprises.9.9.48.1.1.1.5.1 may be the value for SNMPv2-SMI::enterprises.9.9.48.1.1.1.5.16

Bug 12804: Custom Performance Monitoring – when custom transforms are nested, the order may not be preserved resulting in wrong calculations. For example, if custom transforms are defined as “used = transform(used/1024)”, “total = transform(total/1024)” and “memUtil = transform(used/total)”, then the transforms must be calculated in the order used -> total -> memUtil. Earlier releases did not do this.

Rule / Query / Report Engine

Bug 8512: Turn off inaccurate system rule ‘Windows Disk controller problem’

Bug 9847: Add Identity and location to CMDB Report

Bug 10996: Worker down rule did not trigger after license expires

Bug 11008: RFE:  when retrieving Triggered Events for an Incident in GUI or e-mail notification, search 60 minutes before and after

Incident Time. This is fixed by the ‘Trigger Event Query Optimization’ feature

Bug 12322: Increase per rule GROUP BY thresholds – per cust and over all customers

Bug 12558: Improved cache miss handling for profile anomaly rule handling: The profiles for anomaly detection are stored in a SQLite database. When rule engine attempts to look up the average and standard deviation values for a particular key (e.g. IP address, port number etc), and an exact match is not found, then earlier releases picked up the lowest values for that profile in that database. This heuristic often causes unnecessary rule triggers. This release makes tightens the cache miss handling case – profile anomaly rules do not trigger for a key value if the average and standard deviation values are not found for that key value for that time period.

Bug 12640: When performing analytical searches when individual countries from the country groups are referenced in filter conditions as objects, then no results are returned

Discovery

Bug 10363: Disallow discovery via Virtual IP

Bug 10533: Add ability to define IP subnets in the 172.16.16.0/22 type format

Bug 11308: Foundry router becomes generic-generic

Bug 11972: Telnet discovery of HP Procurve switches fails due to error in expect script

Bug 12713: If host name contains unprintable characters like backspace(x08) and enquiry(x05), then parsing this XML causes app server to throw exceptions and run out of memory

Device Support

Bug 9942: RFE: add performance monitoring for Cisco WAPX (lightweight) devices

Bug 10006: RFE:  add device support for Tripp lite UPS devices

Bug 10307: Microsoft cluster services incorrectly assigned to Microsoft Exchange Application Group

Bug 10362: Add support for (Oracle) Acme Packet Border Controller

Bug 10366: Support for Dell Force 10 Networking devices

Parsing  area

Bug 8894: Cisco ASA parser: trailing white space in User attribute causing searches to miss events with condition User EQUALS ‘string’ Bug 10418: Parse username in Windows MSSQL Event 18453

Bug 11351: Parse username in Win-Security-5145

Bug 12485: Parse jitter field in Cisco VoIP CDR/CMR record

Bug 12626: Snort events collected via database have wrong severity

Bug 12641: Added more Symantec Anti-virus events

Bug 12643: A null pointer exception can happen during pulling performance monitor config for discovery

Bug 12656: Some FortiGate traffic logs do not parse if “status=” is missing in the logs

Bug 12668: More Foundry switch logs to be parsed

Bug 12714: Enhance McAfee EPO parser to parse more logs

Bug 12716: Enhance Cisco IOS and NX-OS parser to parse more logs

Bug 12757: Put Fortigate firewall DHCP messages into the identity and location section – so the IP to user and host name mapping shows up when FortiGate is acting as the DHCP server

Bug 12765, 12767: Add a “Total Bit Rate” attribute for interface utilization and Netflow events – so user can quickly run 95th percentile on the total bandwidth for an interface

Data: System Rules/Reports

Bug 8512: Turn off inaccurate system rule ‘Windows Disk controller problem’

Bug 10113: Added description for windows security events: 5142, 5143, 5144, 5168, 4985, 5145

Bug 12660: Enhance “Heavy TCP Port Scan” rule to exclude Windows Security Firewall logs (Win-Security-5156), ASA/PIX Teardown events (ASA-302014, PIX-302014, FWSM-302014)

Bug 12676: The event type group for JUNOS_KMD_VPN_DOWN_ALARM_USER event is incorrect

 

FortiSIEM What’s New in Release 4.3.3

What’s New in Release 4.3.3

AccelOps release 4.3.3 is focused on bug fixes and enhancements.

Bug ID Severity Component Description
13182 major Performance

Monitoring

Performance Monitoring jobs fail when devices discovery credentials are specified in sub-net notation
12604 major Event

Packager

Potential event loss if Supervisor node is down for extended amount of time
13010 major GUI Domain field is missing for manually added users for LDAP authentication
13098 major Rule Excessive Incident Drop Logging may cause parser module to consume high CPU
13020 normal App Server The ‘&’ character in a Rule name causes App Server out of memory error
13028 normal App Server When you discover with VM SDK first and then SNMP/WMI followed by consecutive VM SDK discoveries (e.g. VM SDK->SNMP/WMI->VM SDK -> VMSDK), then discovered information via other means (e.g.

SNMP/WMI) may be incorrectly deleted from CMDB

12953 normal App Server Clear Condition Attribute does not show up without saving the rule
13255 normal App Server Exception thrown during App Server start up caused by SystemConfigManager not found
13011 normal App Server Device maintenance does not work if End Date not set
12994 normal App Server Cannot query user-defined Watch list entries in Rules and Reports
13063 normal App Server Fix XSS vulnerability with Collector registration process
12939 normal App Server If there is an error in delivering a scheduled report, the report name is not captured in

PH_REPORT_ACTION_STATUS event

10302 normal App Server Incident count on Dashboard Calendar View page does not match count in Incident Tab
13027 normal Discovery Juniper SRX firewalls are sometimes discovered incorrectly as JunOS routers and therefore not put in the right CMDB group
13243 normal Discovery HP ProCurve SSH based configuration discovery fails for newer switches
13012 normal Discovery Cisco VoIP phones not discovered when phones do not have MAC address in SNMP walk (Call Manager

V10 and later)

12901 normal Discovery Discovery of Windows Server Host Names differ from 4.2.3 – FQDN do not have highest priority
13119 normal Discovery Discovering interfaces with /31 and /32 mask fails – traditionally these masks are not used in proper IP address definitions
13337 normal Discovery Use LLDP in addition to CDP for Layer2 Port mapping discovery – PCs connected to non-Cisco phones connecting to Cisco Access Switches
12891 normal Discovery Dell PowerConnect Switch configuration discovery via SSH fails for older switches
13190 normal GUI (AO-SP only) Editing the global exception for a rule would overwrite the org exception for the rule.
12921 normal GUI All Devices Dashboard Summary page does not populate when there is a special character (‘&’) in host name
12865 normal GUI Cannot drill down from widget dashboards by selecting a specific value in the charts – used to work in

3.7.6

12936 normal GUI Rules show incorrectly that Clear Condition is undefined, until clear condition is edited or viewed.
13233 normal GUI Report does not run when event attributes has %
13178 normal GUI CMDB Report for Active Rules does not work in Enterprise Edition
13315 normal GUI Dashboard error happens when user renames business service
13279 normal GUI Prev button does not work when searching for keyword in Custom Parser GUI
13221 normal GUI Edit Rule from Incident tab does not work correctly after Group By Name
12007 normal GUI Exceptions are not cloned when a rule is cloned
13122 normal Rule Rule does not fire if the DeviceToCMDBAttr function is used in Incident event type definition
13111 normal Parser Checkpoint certificate encode-decode inconsistent – an extra NULL termination character added to the SIC before encoding can cause SIC mismatch errors during decode and the LEA connection to be aborted

 

11253 normal Parser Possible bug in WatchGuardFirewallParser causes the parser to fail to extract any useful attributes from the log.
13249 normal Parser Avoid reverse DNS look up in syslog for host names that do not match host name criteria
12915 normal Performance

Monitoring

WINEXE does not work for Windows 2012 R2 – this is used for remotely communicating to Windows servers
12910 normal Performance

Monitoring

Custom winexe based performance monitoring: inconsistent behavior- sometimes test returns correct items, however sometimes it also does not return any data
12911 normal Performance

Monitoring

Custom winexe based performance monitoring: Unexpected “Variable <xxx> Not Found” error
13029 normal Performance

Monitoring

Use SNMP/dskTable (first choice) and SNMP/hrStorage (backup) to calculate disk space utilization and reserved space for Linux based systems. Create an event when SNMP/dskTable is not configured.
12845 normal Query Query tasks should be evenly distributed to all Worker nodes instead of assigning to first few Worker nodes
12968 normal Device

Support

False positive on Windows Audit Log Cleared rule caused by not considering Source Name in Windows event log parsing
13007 normal Upgrade Disable SSLv3 and RC4 cypher by default on ssl.conf while upgrading from 4.2.* to 4.4.*
13013 enhancement Device

Support

Add performance monitoring for FireEye MPS appliances
12980, 12979 enhancement Device

Support

Support Cisco Meraki Cloud Controller – discovery, syslog, SNMP trap
12647 enhancement Device

Support

Parse Cisco UCS syslog events
13057 enhancement Device

Support

Add new IPS signature definitions for Palo Alto FW/IDS
12925 enhancement Device

Support

Additional parsing for Sonicwall Firewall events: sent packets and receive packets
13023, 13154,

12946, 13285,

12929, 13001

enhancement Device

Support

Add more parsing for Windows security event logs
12895 enhancement Device

Support

Add event type Win-System-98 for detecting disk corruption
13312, 12933,

13271

enhancement Device

Support

Additional parsing for NetScaler login events
13113 enhancement Device

Support

Additional parsing for TrendMicro OfficeScan syslog
13047 enhancement Device

Support

Additional parsing for Cisco IOS syslog
12932 enhancement Device

Support

Additional parsing for Brocade network switches
13294 enhancement Device

Support

Additional parsing for CiscoNxOS syslog
13000 enhancement Device

Support

For JUNOS cpu monitoring, use 1.3.6.1.4.1.2636.3.1.13.1.21 (jnxOperating5MinLoadAvg) instead of

1.3.6.1.4.1.2636.3.1.13.1.8 (jnxOperatingCPU)

13014 enhancement Device

Support

Additional parsing Cisco Call Manager syslog events
12766 enhancement Device

Support

Add parser for Trend Micro’s Deep Security tool
13104 enhancement Device

Support

Support new format for Cisco IOS OSPF syslog message format
12989, 13103 enhancement Device

Support

Additional parsing for Cisco Ironport Mail appliances – “TCP_DENIED events
12930, 12931 enhancement Device

Support

Additional parsing for FortiGate events
13207 enhancement Device

Support

Discover Virtual Switch hardware information for JunOS

 

13120 enhancement Device

Support

Discover hardware information for JunOS via SNMP
13070 enhancement Device

Support

Parse Dell force 10 syslog
13042 enhancement App Server VA with Collectors: Duplicate devices when a device is discovered by Collector C1 while logs sent to different Collector C2
13043 enhancement App Server Incident Notification via XML/HTTP(S) – do not always require user name and password
13216 enhancement App Server Incident Notification via XML/HTTP(S) – Allow SOAP header and style sheet
13016 enhancement Rule Make the event delay threshold for Rule engine configurable
12996 enhancement Data Optimize “Heavy UDP Host Scan on Fixed Port” rule by excluding DNS traffic
13105 enhancement System Include nload and iotop as part of pre-packaged tools
12934 enhancement System Allow user to disable “Low AccelOps eventdb Disk Space” System Error Messages
10003 enhancement GUI Report event limit in exported or manual reports if the report result count is more than the supported upper limit
13234 enhancement GUI Add a drop down in CMDB for Collectors (in addition to Organizations) – this helps to identify devices associated with a collector
13002 enhancement GUI Add capability to search credential association by IP in GUI – should be able to search for an IP address within an address range or a subnet
13181 enhancement Performance

Monitoring

Provide a framework for computing host performance efficiency index based on Incident Triggers

 

 

FortiSIEM What’s New in Release 4.4.1

What’s New in Release 4.4.1

Features

Windows Agent

Currently AccelOps collects Windows logs and performance metrics using WMI and SNMP, or via third-party agents such as Correlog and Snare. Pulling logs using WMI is expensive and difficult to maintain for high volume logging scenarios. Starting with this release, you can deploy

AccelOps agents to replace most of the above functionalities. AccelOps Windows agents can be purchased in two forms: Basic and Advanced. Basic agents collect Security/System/Application logs, IIS/DNS/DHCP logs, and custom log files. Advanced agents can additionally collect installed software changes, registry changes, file changes for file integrity monitoring,  and specific WMI and Powershell command outputs. Windows agents can be configured via AccelOps Windows Agent Manager using configuration templates. Windows Agent Manager communicates to the AccelOps Supervisor node for licensing/registration, and sends events to Collector or Supervisor nodes in compressed and encrypted form. AccelOps recommends that basic discovery and performance monitoring be carried out via SNMP/WMI, but the log pulling be performed via the agents. See Windows Agent Configuration for more information. Windows configuration manager is available on a separate license, contact sales@accelops.com for more information.

Beaconing

The Beaconing service transmits health and usage information about your AccelOps deployment to an AccelOps Cloud. Beaconing can be basic or advanced. Under basic beaconing, information transmitted includes the health of your AccelOps virtual appliances, CMDB device types, event parsing errors, performance monitoring job health, incident names, and summary information about the configuration of your deployment. Advanced beaconing includes system logs. Note that no specific host name, IP address or user information information is transmitted except the IP address of AccelOps virtual appliance themselves. This transmitted information is used exclusively by AccelOps support for forensic analysis of your system, and is never shared with anyone else. The basic Beaconing service is included as a standard feature in all 4.4+ versions of AccelOps, while a more advanced version can be purchased to provide additional log-based support services. The basic version is turned on by default but you can opt out at any time. See Using Beaconing to Communicate with AccelOps Support for more information.

External Threat Feed Integration Framework for Blocked Domains, Blocked IPs, Malware Hashes and Anonymity Networks

Before release 4.4, AccelOps already integrated with external threat intelligence feeds (such as Torproject.org, MalwareDomainList.com, ZeusTracker, EmergingThreats.net ) to populate blocked domains, blocked IPs, malware hashes and anonymity networks. However, the available integrations were mostly with free websites. Starting this release, user can integrate with their own paid content such as the Threat Stream OPTIC threat intelligence platform and others. A java based API is provided that enables you to integrate with any threat feed. If the threat feed is a website and the data is in the form of a comma separated file (csv) file format, then the integration can be accomplished from the AccelOps GUI itself by simply defining the column mappings and the separator. In all other cases, you will need to write Java classes based on examples provided with AccelOps 4.4. See the topics Custom Malware Domain Threat Feed, Custom Malware IP Threat Feed, Setting Up an External Data Source for Anonymity Networks and Custom Malware Hash Threat Feed for more information.

Integration Framework for External CMDB and Workflow Systems

This framework enables you to integrate AccelOps CMDB and incidents with external systems. Specifically, device information and new device attributes from an external CMDB, such as BMC Atrium, can be imported into the AccelOps CMDB. AccelOps CMDB data can also be

programmatically synched to an external CMDB, such as ServiceNow. AccelOps incidents can be pushed to a external workflow system, such as ServiceNow and ConnectWise – this integration is two-way, as changes in the ticket state in an external CMDB can be reflected back in the corresponding AccelOps incident. The integrations are built on a Java based API. While industry leading platforms such as ServiceNow and ConnectWise are already integrated out of the box, integrations with other CMDBs and workflow systems can be developed using the API. See the topics under Integrating with External CMDB and Helpdesk Systems for more information.

Data Update Service

AccelOps provides built in extensive device support in terms of device discovery, performance monitoring, log parsing, rules and reports. However until now, users had to wait for a formal product release, for example 4.4.2, to get new device support and existing device support extensions such as parser fixes, rule and report extensions. Starting with this release, customers can get device support enhancements, for example 4.4.1.101, via a data update service, in between formal AccelOps releases. As AccelOps continually adds support for more devices, by subscribing to this service, you can receive updated device support as it becomes available, instead of having to wait for a formal release. See the topics under Data Update Subscription Service for more information, and contact sales@accelops.com to purchase a subscription.

AccelOps User Management

This release enables AccelOps administrators to see all the currently logged on and locked out AccelOps users.  Users can be forcibly logged off from the system. Locked users can also be unlocked. Administrators can also see ongoing queries, the user who started the queries, and stop long running queries if needed.

User Interface and Navigation Enhancements

This release includes a number of enhancements to improve the user interface navigation and dashboards. Dashboard charts have now a flat look. The layout changed from column layout to cell layout where smaller charts can be combined with bigger charts on different rows. Cell size can be adjusted by the user on a widget by widget basis. The report selector has been redesigned. Single line chart now has a Gauge display in addition to text. Line charts can be stacked for better visual clarity.  The Table view and combo view now allows user to set colors based on displayed metrics. See the topics under Dashboard Overview for more information.

Revised Product Documentation and Customer Support Portal

The AccelOps product documentation wiki, as well as the customer support knowledge base and community forums, have been completely re-organized and revised for this release to improve the discoverability and usability of information. We welcome your feedback and suggestions for future development at infodev@accelops.com.

Enhancements

  1. Ability to monitor asymmetric network link utilization where send and receive link speeds are unequal
  2. Ability to exclude shared account names from Identity and location calculations
  3. Collector tunnel plugin launch should use super host name from browser to handle NAT deployment
  4. AO-SP: Every organization can have their own “My Home” country definition
  5. Ability to run a query with specific values from Dashboard Charts
  6. Ability to use Incident Category in Rule definition for filtering incidents for user defined rules
  7. Ability to query location name using Analytics framework
  8. Ability to choose a time period in Historical Search by dragging mouse over the time axis

Device Support

Device Access Protocols Used For
Cisco Meraki Cloud Controller, Cisco Meraki Firewalls, Router/Switches and Wireless Access Points SNMP Discovery and Performance

Monitoring

Syslog Security Event Management and

Log Analysis

SNMP Trap Availability Monitoring
Avaya Communication Manager SNMP Discovery and Performance

Monitoring

CDR files pushed to AccelOps via FTP or SCP Call record analysis
Windows Active Directory – health analysis by running dcdiag and repadmin/replsummary commands Remote command execution via

Winexe

Availability and Performance

Monitoring

Windows HyperV Monitoring Remote powershell via Winexe Availability and Performance

Monitoring

Dell Compellent Storage SNMP Discovery and Performance

Monitoring

Bit9 Security Platform Syslog Security Event Management and

Log Analysis

SourceFire NetworkAMP log analysis via syslog Syslog Security Event Management and

Log Analysis

Dell NSeries Router / Switch SNMP, Discovery, Performance

Monitoring

SSH Configuration change monitoring
HP Value Series Switches (19xx Series) and HP 3Com Switches (29xx Series) SNMP Discovery and Performance

Monitoring

SSH Configuration change monitoring

 

Bug Fixes

Edit Document

Bug Severity Module Description
5423 enhancement App Server Provide ability to tune event and per

Supervisor node

12646 major App Server Calendar view of incidents: actual # of
13424 minor App Server Collector tunnel plugin launch should u
13099 normal App Server (AO-SP) Every organization needs it o
11137 normal GUI On Analytics > Rule tab, it sometimes
11416 normal GUI User is not able to edit device under su
12042 normal GUI Drill down from Biz service dashboard
12833 enhancement GUI Can not delete Biz Service from CMDB
12955 normal GUI After editing a newly created user grou
13173 major GUI Identity and location exported PDF con
11350 normal GUI Sometimes the raw event log is empty
9285 major GUI Incidents triggered by user defined rule
       
10593 enhancement GUI Loading Analytics > Historical > Struc
11050 normal GUI A view only user should not be able to
11054 normal GUI If you only keep the Admin tab and hid
12169 normal GUI Quick Info > “Go to Identity” can’t find
12203 major GUI Deleting collector causes problems wh
12285 normal GUI Ticket belonging to an organization w
12539 normal GUI When you copy a search result to a new
12752 enhancement GUI Historical search prior time range menu
12783 normal GUI The Device Time attribute is not prope
12924 normal GUI Creating event dropping rule for an org
12961 normal GUI Custom Performance monitoring: delet
13665 normal GUI Enforce RBAC control on user tab – an
13673, 13625 normal GUI Chinese characters in UI when locale is
12232 normal GUI When user switches to an Organization
12241 normal GUI Important processes defined in Super/g
12246 normal GUI System defined device type will be ove
12274 normal GUI ON DNS Synthetic Transaction Monito
12346 normal GUI Cannot change port value on a newly c
12457 normal GUI Duplicated credential causes JDBC cus
12504 normal GUI An organization user can see Super Glo
12547 normal GUI Restrict customers from adding Organi
12708 minor GUI Need to (re)set to correct default port if
12774 normal GUI Parser XML editor: If search strings co
12802 normal GUI On Firefox browser, email subject does
12902 normal GUI User cannot delete an organization if u
12962 normal GUI Allow more than 255 characters in Reg
12973 normal GUI Restrict user from adding more than 16
13354 normal GUI Cannot delete authentication profiles fo
9973 enhancement GUI Allow user to bulk delete any CMDB g
10044 enhancement GUI Allow to display “latest” vulnerability a
11768 normal GUI CMDB > Applications > Running On t
12001 normal GUI Cloning and Moving CMDB Items resu
12140 minor GUI Should validate email address format w
12347 normal GUI Impact org shows in maintenance colum
12420 enhancement GUI Duplicate Components section in CMD
12434 normal GUI Can create duplicate biz service name i
12534 minor GUI Can not add / edit the description for an
12548 minor GUI Device Maintenance Takes Dates that a
12851 normal GUI CMDB Device Custom Property Thres
12870 normal GUI Allow CMDB Reports to be emailed in
12890 minor GUI The group name does not show when u
13552 normal GUI Drill down does not work for some of w
       

i

 

13681 enhancement GUI Add Location in the CMDB Search dro
2437 normal GUI For hosts, system uptime is calculated
6482 minor GUI Report sort order does not affect to wid
12085 enhancement GUI Extend Dashboard widget extend time
12381 normal GUI Invalid IP addresses with spaces can be
12517 normal GUI App Health page empty for EMC CLA
12724 normal GUI The sort function is lost in business ser
12876 normal GUI Duplicate “Free Array Storage” on Cla
13253 normal GUI Single Line widget on a dashboard doe
13639 normal GUI Dashboard Drill Down from Magnifyin
9610 normal GUI If any report is run with the “Run Late email all show Organization “Global”.
10314 normal GUI Reports with expressions in display col
11544 normal GUI When values are less than 1, heat maps
11804 normal GUI Provide an option to not have charts in
12223 normal GUI Date format in PDF is US date formate
12446 normal GUI Historical Search: Once stopped a quer
12764 minor GUI Schedule report date format should be
12775 enhancement GUI Need to shorten key info in incident vis
4320 enhancement GUI System-defined rule exceptions work f
12276 normal GUI New button is grey in Analytics > Rule
12362 minor GUI The drop down box of subpattern is too
12926 normal GUI Two rules (“Multiple Logon Failures: show “Triggered Event Count” inciden
13383 normal GUI Can’t see email template names in Ema
12454 normal GUI In CMDB -> Devices -> Topo (upper r
13288 normal GUI The incident count is wrong on Inciden
12528 normal GUI PDF export of Event Pulling errors doe
10285 normal GUI Add ability to mail::CC with Email No
13192   GUI In CMDB tab, a device should be filter
10531 normal Data Frequent SVN error – Could not create
10645 major Data InfoBlox NiOS SNMP based discovery
12395 normal Data Palo Alto Firewall: the event PAN-OS-
13600 normal Data Enhance IronPort web parser to cover d
13622 normal Data Sonicwall wlan logs from firewall not p
13667 normal Data Add retry for creating folder in phData
13683 enhancement Data Add Guaranteed eps to these events
13684 enhancement Data Add vmware datastore utilization rules
12411 normal Data Rule “Critical APC Trap” cannot be au
13179 normal Data Uncommon DNS Query Rule triggers u
9654 normal Data Some WinOSWmi Spanish events not
11864 enhancement Data Security Descriptor Field need to be pa
11930 normal Data Certain IOS events not parsed – IOS-E

 

      IOS-LAPP_ON_MSGS-LAPP_ON_

IOS-SWITCH_QOS_TB-TRUST_DEV

11993 enhancement Data Fortigate wireless AP events needs to b
12445 normal Data Incorrect test events for SyslogNG pars
13004 normal Data Need to resolve host name parsed from
13064 normal Data Sourcefire NetworkAMP events not pa
13338 normal Data Windows WMI and Snare parsers have
13341 normal Data Brocade SAN Switch events parsed to
13345 enhancement Data Windows System event types need to i
13390 normal Data Parsing error when [ in attr value in ph
13610 normal Discovery Special character “&” in host name cau
7726 major Identity Need to differentiate between domain u
12267 normal Parser Allow Netflow flows to be dropped lik
13612 normal Parser WMI events ‘Reporting IP’ not parsed c
13743 normal Parser PH_DEV_MON events have incorrect
12985 enhancement Parser Extend the Sender IP choice in Event F
11788 enhancement Performance Monitoring Pre-define some ssh/telnet/winexe jobs
12970 normal Performance Monitoring AO still pulls custom perf events after
13355 normal Performance Monitoring Oracle Acme Packet Controller Session
13611 normal Performance Monitoring Sonicwall interface not monitored corr
13619 normal Performance Monitoring Arista interface does not include link e
13629 enhancement Performance Monitoring Monitor load average for linux machin
13770 normal Performance Monitoring InfoBlox DHCP monitoring memory le
13640 normal Performance Monitoring VMware Cluster Consumed Memory v
11684 major Query / Report Query worker continues to perform sto
11847 normal Query / Report Query may not finish when event cand
10300 enhancement Query / Report Exported query results on super global
12747 enhancement Query / Report Allow customers to report on “Passwor
12884 normal Query / Report Exclude the event ASA-Update-Conn f
12919 normal Query / Report Exported Dynamic watchlists show inc
13439 normal Query / Report (AO-SP) The event PH_DEV_MON_ set to 1 – so network performance effic
12886 normal Rule Add reason for dropping events in PH poorly defined rules.
12913 normal Rule In rule synch error window, when you
10386 enhancement Rule When running Test Rule do not create
13609 normal Rule Network efficiency calculation is incor
10235 enhancement System Allow user to specify Super or Worker
10377 major System Fix the following vulnerabilities – CVE
10566 major System Fix the following vulnerabilities – CV

Cipher

10596 major System SVN password in EC2 build gets reset
       
11649 major System Failure to mount NFS on worker does n
12831 normal System Force AccelOps images to always mou
13008 minor System Disable SSLv3 and RC4 cypher by def
13690 normal System Installation script should ask the user t

in CMDB

Caveats / Open Issues

 

Bug

Id

Issue Workaround
6940 Rule/Query does not work with NULL non-string fields (e.g. Source IP). These entries are skipped. It works however with NULL string values (such as Host name). If Group By conditions have non-string fields, then make sure that those fields are parsed in events.
8867 LAST and FIRST operators in rule group event constraints causes Rule Worker modules to crash Avoid using LAST and FIRST operators in Rule group event constraints
11036 PctChange operator in rule group event constraints causes Rule Worker modules to crash Avoid using PctChange operator in

Rule group event constraints

11112 COUNT DISTINCT operations are expensive for anomaly rules Avoid using COUNT DISTINCT in anomaly rules
12900 Advanced HTTP STM via Selenium plugin does not work for some webpages – root cause is that AccelOps uses python export which does not support the full functionality of the browser plugin. Need to use java export instead of python export. None – use STM on simpler webpages.
13744 Empty strings in synched report results should be exported to Report Server as NULL instead of empty strings. Within Tableau, CAST conversion  operations FAIL when an empty string is encountered, but do not when a NULL is there. None

FortiSIEM What’s New In 4.4.2

What’s new in Release 4.4.2

This release contains the following bug fixes and enhancements.

Bug

ID

Severity Component Description
9906 major Discovery Unable to discover multiple AWS accounts in same organization
13817 major App Server Optimize the display of large number (more than 20,000) of devices in CMDB – the query to obtain locations has performance issues causing Summary dashboard to not load
13858 major Performance

Monitoring

Advanced Web Synthetic Transaction Monitoring must work in all cases
13941 major Discovery AWS CloudTrail API pulls same log more than once
13983 major Discovery SQL server discovery via with JDBC fails with an Java error
14005 major Performance

Monitoring

MSSQL 2008 audit monitoring failed with error info: “Execution failed: Invalid column name ‘IDcol’
14077 major App Server Device properties will not work if property name, device name device group has special characters
14083 major App Server Once we create OKTA external auth profile, certificate will not be updated.
14102 major App Server Optimize large number of concurrent discoveries for Enterprise deployment with Collectors
14177 major System Java run out memory during 4.4.1 upgrade due to  /root/.bashrc did not get copied properly from /opt/phoenix/config/sys/root/.bashrc
14203 major App Server Sometimes business service reports are not deleted when a business service is not deleted – this causes a pileup of extra inline reports that are being run
14221 major App Server Optimize device software patch and device location download to workers and collectors – this causes Workers to not start in large deployments
14254 major App Server Dead lock found when accessing ehcache causing threads to be blocked
14262 major App Server Connect-Wise incident outbound integration – AccelOps overwrites Summary and Status
14264 major System Upgrade sometimes causes GlassFish ownership to become root
14287 major Windows

Agent

Windows Agent sometimes has a memory leak because of improper .NET usage
14299 major App Server Optimize namedValue device group REST API – this causes ReportWorker module startup problems in large deployments
14360 major App Server Rule Exceptions are lost when editing org local rule in org
14393 major GUI Widget Dashboard does not honor RBAC – Read Only User can edit dashboards
10021 normal Query Query result is incorrect for “user IN LDAP User Group”
12987 normal Performance

Monitoring

Need the ability to modify event polling max for JDBC based polling for SQL database
13156 normal Performance

Monitoring

Increase default process count to avoid fork failures
13157 normal Performance

Monitoring

Netap ONTAPI API for Performance Monitoring chooses http, even when https is selected
13355 normal Performance

Monitoring

Oracle Acme Packet Controller Session Count metric incorrect
13483 normal App Server Users with View only permission should not be able to add reports to dashboards
13602 normal GUI  For VA with multiple collectors, sorting by any field for a collector restores entire device lis
13651 minor Data A few reports have no descriptions
13652 minor Data A few reports have incorrect descriptions
13702 enhancement App Server Add the ability to use the CMDB Description or Annotation field in Email notifications
13750 minor Performance

Monitoring

Make timeout configurable for http client – so connections between AccelOps modules and Application Server does not time out
13858 minor Discovery HP 3Com Series switch configuration is not pulled because of missing expect script in release
13911 minor Data APC UPS events are not properly parsed

 

13923 enhancement Data Parse more fields from Cisco CDR records
13953 minor App Server Duplicated disks and networks adapters show in synched ServiceNow CMDB when the discovery or integration schedule interval is short
13955 enhancement Performance

Monitoring

Monitor child device up/down status for Cisco Meraki Cloud Controller
13956 enhancement Data Need additional parsing for several Win-Security events
13976 minor App Server Executive Summary Dashboard: Super/local view show other organization’s locations
13986 enhancement Data Parse more SNMP traps for Cisco WLAN Controller
14002 enhancement Data Parse more McAfee Intrushield IPS events
14006 enhancement Data Collect CPU and memory information for WLAN Controller
14037 enhancement Data Parse more field for Cisco_UC_RTMT_ExcessiveVoiceQualityReports log
14082 enhancement App Server Provide warning for running Incident outbound integration on demand or on schedule to make sure user understands that tickets will be created for old incidents
14085 minor Data HyperV Remaining Guest Memory Rule has wrong operator
14086  normal App Server Optimize the performance of distribution of big IP and domain lists (in malware feeds) from Supervisor to worker nodes. Currently Worker nodes take a long time to initialize because of long download times
14090 normal Discovery Cisco IOS Running config can not be obtained in some cases because of short timeout in expect scripts
14091 normal Discovery Cisco ASA config not discovered when the account has higher privilege (no enable mode)
14092 enhancement Data Eliminate unnecessary “Performance monitoring jobs not picked up for execution” rules that trigger during large discoveries
14093 enhancement Discovery Discovery Windows Server Serial Numbers via WMI (in Bios)
14095 normal System VM console blue screen shows version 4.3.3 after upgrade to 4.4.1
14096 enhancement Data Add support for QNAP logs
14098 normal Data System defined Read only User role can force log out other users
14101 normal Performance

Monitoring

Config discovery timeout causes config change rules to trigger
14103 enhancement GUI Bulk select is not available on CMDB>Blocked IPS
14107 enhancement Data Turn Ping suppression off by default – feature not fully developed
14111 enhancement Data Parse syslog for Dell N Series Switch
14113 enhancement System Allow back-end process to be started only using admin account (not root account)
14134 normal App Server Failed to get report bundle results in some case
14189 minor GUI In Analytics Trend charts, y-axis data is not shown in bits/sec
14197 minor GUI Search filter in group editor removes filtered out items
14201 enhancement Data Drop Netflow IPv6 flow records since IPv6 is not handled currently
14204 enhancement GUI Allow users to choose filters when adding reports to filters on a business service
14211 minor GUI “Locked Users” screen sometimes freezes the GUI
14248 enhancement GUI Allow users to keep the same report name after edit (for user reports)
14255 enhancement Data Move “My Dashboard” to the 3rd place from the top after Incident dashboard to prevent excessive scrolling
14263 enhancement App Server Add 2-factor authentication via RADIUS
14268 enhancement Data Add new reports for Windows Agent
14271 enhancement Data Some Bit9 Carbon Black events not parsed
14279 minor Performance

Monitoring

JDBC Custom Perf job fails because of special character in returned XML
14314 minor Data Parse logon process for Windows logs via Snare for Win-Security-4624 – without this fix, Identity location page not updated
14361 enhancement Data Support different UI logos for organizations
14383 enhancement Performance

Monitor

Extend support for Jboss 7.1+ (App server metric monitoring)

 

 

FortiSIEM Whats New In 4.4.3

What’s new in Release 4.4.3

This release contains the following bug fixes and enhancements.

Bug

ID

Severity Component Description
13806 Major Performance

Monitoring

Server restart detection based on up time does not always work correctly in one case – if the server was in maintenance mode and this is the first time after maintenance and there was a server restart during maintenance.
14527 Major App Server Newly created Blocked IP and Domain groups can not be always downloaded correctly by the back end modules because the name in malware value group is incorrectly replaced by natural Id
14565 Major App Server Adding an Incident related report to Business Service Dashboard can cause the Dashboard to not show results
14650 Major App Server Upgrade from 4.4.1 to 4.4.2 may lead to duplicate Windows Servers in CMDB. In 4.4.2, hardware serial number is added to Windows server from Bios discovery via WMI. If a windows server existed in CMDB before 4.4.2, rediscovery in 4.4.2 would create a new windows server in CMDB with hardware serial number. The two windows servers one without hardware serial number and one with, would nor be merged. Workaround in 4.4.2 would be to delete the Windows server without hardware serial number.
14652 Major App Server Some rules created before 4.4.2 does not work after upgrade. The rule caching optimization introduced in 4.4.2 has a bug which ignores some rules with empty created date values. Workaround in 4.4.2 would be to disable and then re-enable the rule.
14705 Major App Server User edits to interface speeds are overwritten by Discovery. This bug was introduced when we added two fields – sent speed and receive speed to replace the single interface speed
14726 Major App Server Custom properties (such as global CPU utilization thresholds, per-device CPU utilization thresholds) are lost after upgrade
14201 Normal Parser Drop IPv6 net flow records if IPv6 and IPv4 records are mixed in received Netflow records – since we do not currently handle IPv6 records and they take up lots of storage space
14476 Normal System Disable rate limit on rsyslog – this would ensure that all internal logs would be accurately received by the system
14477 Normal Performance

Monitoring

Performance Monitor module crashes sometime due to memory corruption
14528 Normal App Server Blocked Domain and IP fields can not be downloaded if a field contains double quote in a field
14666 Normal Performance

Monitoring

The character \” in raw message causes custom WMI based performance monitor to have errors
14690 Normal Data The “A system User Created” rule in incorrectly categorized as a Availability rule
14700 Normal Data

Manager

Do not abort when DataManager module fails to create directories in NFS. Create a log

PH_UNABLE_CREATE_DIR_1. The rule “System Critical: DataManager event store failed” would trigger.

14724 Normal Report

Worker

In the Summary dashboard, the display of Availability Status column depends on the display of Ping Packet Loss column. So if the Ping Packet Loss column is removed, then the Availability Status column is also not displayed.
14395 Enhancement System Optimize the number of value group requests from back end modules to Application Server by caching – this would reduce the load on the Application Server specially when there are lots of value groups resulting from large number of organizations, business services or large number pf CMDB Objects used in rules and reports
14567 Enhancement System Beaconing – report Unknown Event Types as aggregates – not the raw events themselves
14584 Enhancement Discovery,

Performance Monitoring

Add discovery and Performance Monitoring for Cisco FirePower IPS module
14688 Enhancement Discovery,

Performance Monitoring

Add discovery and Performance Monitoring for Dell NSeries 4xxx switches
14691 Enhancement Discovery,

Performance

Monitoring

Add discovery and Performance Monitoring for H3C Comware
14684 Enhancement App Server Bound the number of API downloaded Threat feed entries in the AccelOps CMDB – by default we never keep more than 100K active entries per threat feed group in AccelOps CMDB by default. This number can be increased or decreased by the user at their own risk. Since there is not guarantee on the quality and number of items in the external threat database, a sudden surge of downloaded entries can have detrimental effect on AccelOps system performance.
14720 Enhancement Data Parse a new format of Bit9 syslog
14651 Enhancement Data Parse Dell NSeries syslog
14671 Enhancement Data Squid Parser needs enhancements for RHEL 7 and squid 3.3
14694 Enhancement Data AccelOps Windows Agent generated DHCP logs must also populated Identity location table

 

14699 Enhancement Data Add 11 more Windows Security event types

 

 

FortiSIEM What’s New in 4.4.5

What’s new in Release 4.4.5

This release contains the following bug fixes and enhancements. It fixes several issues that were newly introduced in 4.4.3.

Bug

ID

Severity Component Description
15111 Major GUI (AO-SP) Rule exceptions created under an organization are not saved
15160 Major GUI Malware hash update via API does not work
15121 Major Parser Netflow events may be dropped because templates not maintained correctly. This was newly introduced in 4.4.3.
15075 Major System Clear cache operation in phMonitor module could keep global cache lock and blocking global cache access. This was newly introduced in 4.4.3.
15099 Major System Lack of mutex can cause a deadlock in phMonitor causing the system to not function correctly. This was newly introduced in 4.4.3.
15074 Major Query A race condition may cause Query Worker to enter a deadlock stage preventing queries from progressing.
15104 Major Performance

Monitor

Class based QoS data not generated even though the job is added.
15101 Minor Application

Server

Too many sockets opened while running a scheduled Report bundle may cause queries to fail.
15102 Minor Application

Server

(AO-SP) Rulemaster module may not pick up user changes on Rule exception for a specific organization
14834 Normal System Partial archives directory can prevent Event DB purging leading to Event DB becoming full.
15112 Normal GUI (AO-SP) Rule Exception notes not saved in per Org level
15100 Normal Application

Server

Improper exception thrown by Application Server on an invalid query may block other queries from progressing.
15162 Enhancement System Disable AccelOps internal Apache logging.
15163 Enhancement System Download of CMDB Objects containing large IP values (e.g. Blocked IP object containing malware data) needs to be optimized.
15166 Enhancement Data Handle new version of Cisco FirePower logs.
15176 Enhancement GUI Identity and location may take a long time to load if the default time window is 1 day – set the default to 1 hour.

 

 

FortiSIEM What’s New in 4.5.1

What’s New in Release 4.5.1

NEW RELEASE 4.5 UPGRADE REQUIREMENT

Starting 4.5, Supervisor requires 24GB RAM. The increase from 16GB RAM in prior releases is needed for the data collection robustness and visibility feature.  Supervisor node is now caching device monitoring status for faster performance by avoiding database I/O. Without the additional RAM, Supervisor node will not operate properly.

 

This release adds features and functionality in several areas.

Platform Features

Data collection robustness and visibility

Export events to other Big Data systems via Kafka

CMDB Outbound Integration for ConnectWise Dashboard slideshow

Performance and Availability Monitoring

Maintenance calendar for Synthetic Transaction Monitor jobs

Real time performance probing

SLA calculation for SNMP and WMI Ping

Trace route monitoring

Log Management and Security Monitoring

Multi-tenant reporting device handling

Windows Agent Enhancements

Device Support

New Support

Enhanced Support

Significant Enhancements

DataManager and ReportWorker module robustness

Additional metrics on trend charts

Simplify Cloud and Collector health GUI

Ability to manually add hosts to Application Groups

Set important process and critical interface definitions directly from CMDB

Dashboard charting enhancements

Accounting for internal and performance monitoring events

Ability to change event database purge/archive thresholds

Ability to set remote directory renaming action during archive Registration APIs

Bug Fixes / Enhancements

Current Open Bugs/Enhancements

 

Platform Features

Data collection robustness and visibility

This release enhances the reliability and visibility of AccelOps data collection in the following ways.

Detailed visibility on when data was last collected: (a) data from performance monitoring jobs on a per device, per job basis and (b) data pushed from external devices on a per device per protocol basis. Last collection times are visible by simply visiting CMDB > Device > Monitor tab. The times are updated frequently (every 2 minutes).

A versioning scheme is introduced to make sure that the Application Server and the data collection agents (Java agents and Performance Monitor modules in Collectors, Workers) are always in sync. This ensures that when user changes (either manual or from discovery) are always reflected in data collection. If there is a version discrepancy, means that data collection agents are not working on the most up to date version, an alert is created based on a system rule.

System rules are provided for the following error scenarios: User can decide to restart a module or the entire application via a notification policy/remediation scripts.

  1. all jobs on a data collection agent are delayed
  2. a particular job on a data collection agent are delayed
  3. a version discrepancy is detected – a data collection agent (Collector, Worker) has not picked up the correct monitoring version within a certain amount of time

Details on how data collection times and status is reported in CMDB are here.

Export events to other Big Data systems via Kafka

AccelOps collects a wide variety of logs and performance metrics and uses the data for its own analysis. This release enables users to export the logs in a parsed format to any external system via Kafka, a highly scalable distributed message bus (see Apache Kafka). AccelOps has developed a connector that publishes to the Kafka message bus. This feature can be used to populate a Big Data system with rich AccelOps data.

Details on configuring AccelOps for Kafka export is discussed here

CMDB Outbound Integration for ConnectWise

ConnectWise is an important help desk / ticketing system specially for service providers. AccelOps already has two-way integration with

ConnectWise ticketing – a ticket can be created in ConnectWise and state updates in ConnectWise is reflected in AccelOps. This release extends the integration to cover CMDB. When AccelOps discovers a device, ConnectWise CMDB can be populated, either automatically or on demand. When AccelOps discovers changes, the change can be synced to ConnectWise. A framework is provided to convert device attributes like Organizations, host names, device types to ConnectWise specific fields and fields.

Details on configuring AccelOps for ConnectWise outbound CMDB integration is discussed here. AccelOps provides a special content mapping feature where any AccelOps CMDB attribute and values can be converted into a corresponding ConnectWise CMDB attribute and values (see Step 11).

Dashboard slideshow

Users are now able to select a set of dashboards and display them in a slideshow mode on big monitors to cover the entire display. This is useful for Network and Security Operation Centers.

Details on creating dashboard slideshow is discussed here.

Performance and Availability Monitoring

Maintenance calendar for Synthetic Transaction Monitor jobs

This release allows the ability to add Synthetic Transaction Monitor (STM) jobs to a maintenance calendar. While a STM job is under maintenance, the job is not executed and system rule does not trigger if the job fails.

Details on how to create maintenance calendars for STM jobs is detailed here.

Real time performance probing

Often for checking the health of a device or an application, it is necessary to probe the device and check its current performance metrics. Until now, the option in AccelOps would be to query the system for performance monitoring events – this does not quite serve the purpose since the polling intervals are too large (3 minutes of so for most jobs) – so you would not get results for next 3 minutes. This release allows users to probe the device at a much faster pace (e.g. few seconds apart) and see the metrics in a real time scrolling fashion on the GUI. These metrics are polled in addition to the regular scheduled performance polls – they are neither stored nor do they trigger any rules or are part of any report. Currently, only a subset of important system performance metrics are supported for real time performance probes, e.g. system CPU, memory, disk, interface and process utilization.

Details on how to probe devices for real time performance metrics is discussed here.

SLA calculation for SNMP and WMI Ping

Until now, we calculated Min/Max/Average Round Trip Time, downtime and SLA for ICMP Ping only. This notion is extended for two other critical performance monitoring protocols – SNMP and WMI.The events PH_DEV_MON_SNMP_PING_STAT and PH_DEV_MON_WMI_PING_STAT now contain the following additional attributes

Average Round Trip Time (RTT)

Max Round Trip Time

Min Round Trip Time

Pct Packet Loss

System Down time

System Degraded Time

SNMP Ping is calculated by issuing a very basic SNMP OID (1.3.6.1.2.1.1.1 – sysDescr in MIB-2) that is present in all SNMP implementations. WMI Ping is calculated by fetching a basic WMI Class (Win32_OperatingSystem) that is present in all WMI implementations.

Statistical computations (e.g. max, min, average) are done by sending 5 requests for the same object a few seconds apart. System is considered down for the polling interval if packet loss is 100%. System is considered degraded for the polling interval if packet loss is less 100% but greater than 50%.

Two reports are provided

Top Devices by SNMP RTT

Top Devices by WMI RTT

Trace route monitoring

Trace route is important for monitoring hop by hop latency between two wide area end points. It is important to know when latency for a particular hop increases significantly – this is often a precursor for internet outage. This release allows users to run trace route from any AccelOps node to any destination using the Synthetic Transaction Monitoring (STM) framework.

Details on how to set up trace route monitoring is described here. One report is provided: Top Trace Route Hops by RTT.

Log Management and Security Monitoring

Multi-tenant reporting device handling

This release allows AccelOps to handle reporting devices that are themselves multi-tenant. As an example, a Fortinet firewall can report logs for multiple organizations from the same source IP – the organizations is reported via the Virtual Domain variable. As another example, Qualys Vulnerability Scanner can report vulnerabilities for the devices belonging to multiple organizations in the same report via the qualysAssetGroup attribute.

A framework is provided to handle multi-tenant reporting devices. User can set up mapping rules specifying

attribute that specifies the external organization in the log. mapping between external organization to AccelOps organization.

Using these definitions, reporting devices are created and logs are mapped to the respective organizations. Subsequently, rules also trigger in the respective organizations. Details are in Event Organization Mapping.

Windows Agent Enhancements

This release provides several enhancements

  1. AccelOps Windows Agent and Agent Manager now communicate over HTTP(S) instead of HTTP
  2. File integrity monitoring events will now contain users that made file changes
  3. Ability to export and import license and monitoring template assignments
  4. Support for non-English locale for Windows Servers
  5. Differentiate between files and directories in AccelOps-WUA-FileMon events by using the osObjType attribute. This information is provided for the following cases: (a) create, (b) change, (c) rename but only for the new name. This information can not be provided for the following cases: (a) delete, (b) rename – for the old name.

Windows agent upgrade and configuration is covered here.

Device Support

New Support
  1. Nutanix – discovery and performance monitoring via SNMP – see here
  2. Cisco FireSIGHT integration via eStreamer API – log monitoring – see here
  3. AWS RDS and EBS – performance monitoring – see here
  4. Airlines in-flight entertainment systems monitoring
  5. Qualys Web Application Firewall log monitoring – see here
  6. CiscoWorks Network Control Manager (NCM) – log monitoring – see here
  7. Lantronix SLC Console Manager log monitoring – log monitoring – see here
  8. Vasco DigiPass – log monitoring – see here
  9. Juniper DDoS Secure – log monitoring – see here
  10. Cisco Wide Area Application Services (WAAS) – performance monitoring – see here
  11. Motorola AirDefense Wireless IDS – log monitoring – see here
  12. Motorola WiNG WLAN Access Point – log monitoring – see here
  13. Cisco Telepresence Video Communication Server – log monitoring – see here
  14. Application server log monitoring – Redhat JBoss, IBM Websphere and Oracle Weblogic – see here 15. Brocade ADX load balancer – performance monitoring – see here
  15. Ruckus Wireless LAN – performance monitoring – see here
  16. Fortinet FortiManager – performance monitoring – see here
  17. NetBotz NBRK 2000 – environmental monitoring – see here
  18. Cisco NBAR monitoring – see here
Enhanced Support

VMware SDK 5.5 API integration – AccelOps automatically uses the API for the right VMware version.

Nessus 6.0 integration – AccelOps automatically determines the right Nessus server version and uses the right API for server versions 4, 5 and 6.

Significant Enhancements

DataManager and ReportWorker module robustness

In this release, DataManager and ReportWorker do not restart under the following conditions

NFS is temporarily not available

Unable to create directories during writing or purging

The modules fall behind in reading shared buffer storage

Additional metrics on trend charts

Users can now see maximum, minimum, percentiles and simple moving averages directly in trend charts in Analytics and Dashboard sections.

Simplify Cloud and Collector health GUI

Users can select what columns to display in Cloud and Collector health pages under Admin tab. By default, fewer columns are displayed now.

Ability to manually add hosts to Application Groups

Device and Application groups are important CMDB objects that allow users to write targeted rules and reports. Until now, Application groups were only populated by discovery. This release allows users to manually add to Application groups in cases where discovery is not practical.

Important user case:

Suppose a rule triggers, namely  Excessive DNS requests from a host. The host is actually a DNS server which was not discovered. There is need to create an exception for this rule for this DNS server. Three choices –

  1. Create a rule exception for this host – sometimes this is not very manageable long term since the fact this is a DNS server can not be used in other analytics
  2. Discover the host and make sure that the host is in the DNS server group – sometimes this may not be practical.
  3. Manually add the server to the DNS server group using this feature. The DNS server group can be used for other rules and reports.

The rule would stop triggering – as desired

Set important process and critical interface definitions directly from CMDB

A important process and a critical Interface are always monitored for up/down status. Before this release, these needed to be configured from Admin > General Settings. Setting important process was difficult since one had to type in the process name, This release allows user to set these directly from CMDB > Device.

Dashboard charting enhancements

The following improvements are added

For Bar charts, the legends appear next to the charts and not at the bottom. This improves legibility.

Maximum number of displayed entries are increased form 50 to 200.

Accounting for internal and performance monitoring events

AccelOps has 3 kinds of logs/events

External logs – these count towards the licensed eps

Performance Monitoring events generated by AccelOps when it monitors a device – these also count towards the licensed eps

Internal system logs – generally reporting errors and important informational events – these do not count towards the licensed eps

Since each of these log types have to indexed, stored and since they trigger rules and reports, system performance can be affected. This release provides accurate accounting of these event types via the phstatus commands and also system provided reports. See here for details.

Ability to change event database purge/archive thresholds

By default AccelOps starts to purge (or archive if archive is set) when the free space in event database falls below 10GB. This continues until free event database space reaches 20GB. In very high event rate situations, this 10GB buffer may not suffice and database may become full. This release allows the values to be customized by the user. In phoenix_config.txt, under the phDataManager section, modify the low_space_action_threshold and low_space_warning_threshold values and restart the phDataManager module. This needs to be done at Supervisor and Worker nodes.

Ability to set remote directory renaming action during archive

When AccelOps is archiving and the destination directory already exists, then you can configure AccelOps to either rename the existing directory and archive new data to that location or skip archiving

Registration APIs

Three new APIs are provided for the following functions. For details, see here.

Register Workers to Supervisor

Register Collector to Supervisor

Register Supervisor to AccelOps License Manager

Bug Fixes / Enhancements

 

Id Severity Component Description
15147 Major System Separate Chinese language support from English versions
13921 Major Application

Server

SANS Low Sensitivity does not update by the system default API
14228 Minor System New install images for Collector and Super utilize the same OS RPM packages
14695 Minor System AccelOps can not connect to the Internet via a Proxy
14940 Minor System Address Web Server HTTP Trace/Track Method Support Cross-Site Tracing Vulnerability:

(CVE-2004-2320, CVE-2007-3008) by disabling the ability to respond to HTTP TRACE requests

15079 Minor System Secure Redis service running on Supervisor node by disallowing access from the outside
13647 Minor Application

Server

Stopped Report Generates an Application Exception when it is re-ran
14409 Normal Application

Server

Need to escape special character in rule definition xml
14274 Normal Discovery VCenter discovery – sometimes a folder shows no VMs in Dashboard > VMView
15020 Normal GUI Can’t adjust sliders on Dashboard Widgets with multiple sliders
14347 Normal GUI Add/Modify Rule Exception causes Rule to Save with a new name
14474 Normal GUI External lookup broken on Summary Dashboards
14667 Normal Performance

Monitoring

Changing a Custom WMI (not just WMI) does not take effect even after discovery
14469 Normal Device

Support

Default WMI Parser not parsing Sharepoint Event Types Correctly
13393 Normal Discovery Resolve device hostname for ping only discover devices
13811 Normal Performance

Monitoring

No Performance Data Collected After Fortigate Firewall upgrade to version 5.2.3
13626 Normal Rules Refined Sub-pattern in “Black List User Agent Match” to reduce false positives
14417 Normal Application

Server

Discovery merge need to OVERWRITE device group also instead of add on
15014 Normal GUI CMDB Device filtering does not work when Reporting IP can be resolved by DNS
15177 Normal Parser Some IOS hardware failure events do not parse
15182 Normal Performance

Monitoring

Device interface utilization may not be reported because of XML size overflow (extra large deployments)
14474 Normal GUI “External Lookup” broken on Summary Dashboards
12992 Normal Application

Server

Reverse Tunnels do not timeout as described
8515 Normal Discovery NetBotz NBRK0200 is not discovered as NetBotz
12319 Normal Performance

Monitoring

Add Provisioned disk size into PH_DEV_MON_VM_DISK_UTIL event
13954 Normal Performance

Monitoring

Memory Utilization for HPUX process reported as higher than actual Physical Memory Utilization
14576 Normal Performance

Monitoring

PH_JAVA_AGENT_ERROR due to vmDataStore perfmap wrong key
14826 Normal Application

Server

When App server is restarted, false Collector down emails are sent out
14844 Normal Application

Server

Need to turn off Beaconing report generation when Beaconing feature is turned off
14935 Normal GUI CMDB Exception Report does not correctly populate customer (Org)
7463 Enhancement GUI Allow Location information in custom email template
13068 Enhancement GUI Location CSV import needs to be able to do the following (a)intelligently find the entry, (b)merge the entries with changes that are necessary and (c) provide a UI update to tell which entries were updated with changes
13726 Enhancement GUI Use labeled bars on bar charts rather than a legend
14212 Enhancement GUI Add a CMDB report for clear rules
14585 Enhancement Application

Server

Optimize CMDB Object REST API for EventType, BizService, Device, Application groups via App Server caching technique
14701 Enhancement Application

Server

Selenium import utilizing java web driver instead of python web driver scripts
14775 Enhancement GUI In CMDB page, change “Last Updated Time” to “Last Discovered Time” and “Last Updated Method” to “Last

Discovered Method”

14781 Enhancement GUI Widget dashboard – Table View – Allow one table for whole dashboard
13809 Enhancement GUI Format report bundle PDF output – show correct page index, remove total number of pages
14989 Enhancement GUI In Rule/report filter condition, allow user to choose any event attribute attribute IN CMDB Object
14760 Enhancement GUI In Admin > Setup > Change/Performance Monitor page  – Do not show devices deleted by discovery
15149 Enhancement Rule / Query

Engine

Optimization of Rule and Report Worker for large IP Value Set
13776 Enhancement Reports CMDB Report added to show Rules with Clear Conditions
15141 Enhancement Device

Support

Merge Windows via Log Discovery Using machine GUID
13726 Enhancement GUI Using Labeled Bars on Bar-charts Rather than a Legend
14474 EnhancementGUI   Allow user to not show Event Type in Dashboard (save precious space)
15059 Enhancement Device

Support

Additional Parsing for DNS Bind (RPZ)
15091 Enhancement Device

Support

Handle Unknown event types for Ironport Mail and Web events

Current Open Bugs/Enhancements

Id Severity Component Description
8867 Major Rule Engine LAST and FIRST operators in rules do not work (may crash Rule Worker module)
11036 Major Rule Engine Rule Worker module may abort when a PctChange Expression is used
14242 Major Query Engine RBAC data conditions not enforced for SP organizations when login in via the super org and moving to another org.
15022 Major Parser Engine Parser module may stall/pause if a host name resolution is slow
11112 Major Rule Engine COUNT DISTINCT operations consume large resources for rules utilizing Anomaly Detection
14478 Major GUI Sometimes GUI pops up warning (Large amount of data stored over the boundaries) when users restore the archived data or delete the restored data
15109 Major Performance

Monitoring

Failed Custom JDBC job shows in performance page after Discovery
14766 Major Application

Server

LOG discovery does not work properly with multi-tenant reporting devices
15230 Major Parser Syslog-over-TCP does not work correctly
15247 Normal Parser AIX Parser cannot parse events correctly.
15253 Normal Parser Reporting device name is parsed wrong in LinuxInotifyParser (affects Linux file integrity monitoring via AccelOps agent)
14929 Normal Performance

Monitoring

Maintenance calendar issue – Maintenance for a device does not start at the configured time if there is a long running disabled job of another device
15068 Normal Application

Server

Dashboard Search Filtering Does not work for Clariion LUNs under Summary Tab
15231 Normal Application

Server

Generating PDF Reports over 100 Pages will drop Page Footer
15294 Normal Parser Strange device types may be created by Netflow based LOG discovery. This does not affect system operation.
14829 Normal Documentation Rule syntax invalid if use “regexp” as the sub-pattern name

 

15233 Minor Application

Server

“Validation Status” column in Admin->Event DB->Event Integrity does not allow for sorting.
15300 Minor GUI For Report Server, if you sync -> unsync -> sync is rapid succession, then the last sync may not take effect
9261 Enhancement Application

Server

Charts in exported reports (PDF format) only contain stacked charts – not line charts