Tuesday, November 16, 2021

Key Logs When Troubleshooting Demantra Issues - From Installation to Operations (Doc ID 741464.1)

 In this Document

Purpose
Scope
Details
 
1. Installation of the Demantra Base Application, Patches or Version Upgrades
 2. Error starting the Web Server and/or deploying the Demantra WAR file
 3. Error logs for the Demantra forecast engine - batch or simulation
 
4. Stored procedure errors with Active_Proc_Dyn somewhere in the error message
 5. End user errors, when they occur in a Demantra worksheet, or when end user updates appear not to be processed or saved correctly.
 
6. Errors with Workflows or Level Methods that call Workflows (ex. Load Scenario Data)
 
7. Integration Interface / Transfer Step / APS.bat / APS.exe Errors or Data Issues   
 
8. Errors with Member Management or Chaining
 

9. Issues with EBS/ASCP Integration to/from Demantra (ex. Shipment and Bookings, SCI Data, etc..)
 
10. Error with Legacy Demantra Scheduler Application (ex. Manuals_Ins, Dynamic_Sync, etc.)
 
 
11. EP_LOAD PROPORT and MORE Can Use LOG_IT to Enhance Log File Information
 Summary
References

APPLIES TO:

Oracle Demantra Demand Management - Version 7.0.2 and later
Information in this document applies to any platform.

PURPOSE

This document outlines the location of the main troubleshooting logs that you will need during all phases of Demantra Installation, Go-Live and Lifecycle Support. 

Note that while this list is not exhaustive, or necessarily valid for all Demantra versions, it is meant to provide the locations of those logs that would commonly be used during first and
second line troubleshooting.  Also, it should be stated these logs may not lead to the actual resolution of your issue but are meant to provide extra clues which could then be used to reference
other Support Notes and/or can be provided to Oracle Support. 

Please check out the referenced documents at the bottom of this note.

Any questions about these logs or tables should be directed to Oracle Support.

SCOPE

This note should be used by anyone responsible for installing and/or maintaining the health of the Oracle Demantra Application

DETAILS

 


1. Installation of the Demantra Base Application, Patches or Version Upgrades

   For Clients installing or upgrading Demantra Versions 7.2.0 and higher then please refer to Note 1077000.1 for new logging options.

   Note that there will also be some ancillary logs under the following folders:
 
   .. Demand Planner\Database Objects\Oracle Server (Oracle back end database)

   .. Demand Planner\Database Objects\Microsoft SQL Server (Sql Server back end database)

     

More information on troubleshooting the Demantra base installation process is found in Note 430913.1

    

2. Error starting the Web Server and/or deploying the Demantra WAR file

Review the Collaborator.log which is found under the ...Collaborator\demantra\logs folder on the webserver where Demantra is running.  Also, each individual    webserver (ex. OAS, JRUN,   Tomcat, Websphere, etc...) will have their own individual logs in various directories which can also be consulted.  The individual    webserver documentation should be reviewed for these log locations.

3. Error logs for the Demantra forecast engine - batch or simulation


  

When the Engine Executables are installed on Windows, additional troubleshooting tips for the Demantra Batch Engine are found in Note 848205.1.


   The key engine logs are found under the root drive of the machine where the engine executables are located and the engine is launched from.  If you are using
   the distributed mode (ex. running the engine on Machines A, B and C):

   If the primary engine is on Machine A then all logs will be found on that Machine.  The folder on that machine, that holds these logs, usually have Engine2k somewhere in the name.
   Note that there should be at least Engine2k logs, these logs record the actual splitting and forecasts that the engine does, present in this folder.

   However, to write the primary EngineManager logs to this folder you need to go to the Engine Administrator
   (..Demand Planner\Analytical Engines\bin  --> Settings --> Configure)
   and change the Engine Manager Log tab from STD to FILE.  If you did not have Log set to FILE then we would expect you to re-run the engine one more time so that
   we can record this additional logging.

   Note: It is NOT advised to re-register the engine after making this change

   When the Engine Executables are installed on Linux (new option starting in Demantra v73)

   Engine and EngineManager logs are placed at the same level as installed BIN and LIB directories.  They can be accessed under $ENGINE_ROOT/engine2k directory.
   Sub directories are arranged according to schema name, machine name and run time.  Log placement can be configured in $ENGINE_ROOT/bin/Settings.xml file, relative to $ENGINE_ROOT/lib/Engine.exe location or by supplying full path.


4. Stored procedure errors with Active_Proc_Dyn somewhere in the error message

   To view the errors go to Business Modeler -->  Tools --> Procedure Error Log

   Note that this looks to the backend table called db_exception_log  
 

5. End user errors, when they occur in a Demantra worksheet, or when end user updates appear not to be processed or saved correctly.


   The important log that we want to review with end user issues (ex. screen freezes, error messages appear when running or editing a worksheet, end user updates
   are not being processed*, etc..) is the Java plugin log.

   There are two ways to get this log:
 
   1) In the bottom, right hand part of the machine you will see a Java coffee cup icon.  Right click on it > Open Console.  Note that if there are more than one
      icon then look for the log that referencesDemantra in the URL

      To make sure that you are not including old messages, press the clear button and then try to recreate the issue again.

   2) Clear your browser cache:

  • For IE, Hold the Ctrl key and press the F5 key - Or - hold the Ctrl key and click the Refresh button on the toolbar
  • For Mozilla Firefox, hold down the Ctrl key and then press F5 - Or - hold down both the Ctrl and Shift keys and then press R
  • For Chrome Either: Hold the Ctrl key and press F5 - Or - hold the Ctrl key and click Reload button


      If the machine has frozen up then a log is still usually saved on the back end of the machine.  This can usually be found by going to C:/Documents and
      Settings/<Username>/Application Data/Sun/Java/Deployment/log

      If there are no errors evident in the java plugin log then go to the Collaborator.log found under:
 
      http://< Host Name of Webserver : Port Number>/demantra/admin/systemLogs.jsp

      For example if you normally log into Demantra using the following URL:

      http://DEMANTRAMACHINE:8080/demantra/portal/loginpage.jsp

      then these logs would be accessed by going to:

      http://DEMANTRAMACHINE:8080/demantra/admin/systemLogs.jsp

      An alternative way to view these logs is to go directly the machine hosting the webserver and go to the logs found under ...Collaborator\demantra\logs
      (note that this a Windows Directory path example and Demantra, when deployed on non-Windows boxes, will still be under this folder path but obviously with
       different directory navigation steps)

      Look for the entries in the log around the time of the error (note that the webserver might be in a different timezone so an error for an enduser in New York
      at 4pm will show up at 1pm in the Webserver based in California)

      Enhanced Logging for End User issues can  be recorded by going to:

      http://< Host Name of Webserver : Port Number>/demantra/admin/loggerManager.jsp

      For v7203 and lower once there, turn on the following lines (note that if the button is marked TURN ON then actually it is OFF.  Once the button is marked
      TURN OFF then the logging is actually ON which is what we want).  For v730 and higher these will have check boxes instead of ON/OFF buttons.

  • appserver.sql
  • appserver.audit_trail_sql
  • appserver.update.operation
  • appserver.update.process
  • appserver.update.sql
  • appserver.retrieve.sql
  • appserver.retrieve.data.sql


      Note that this logging will be turned off either by the next time the webserver is restarted or by the user turning off the lines that were earlier turned on.

      * For issues where updates are not being reflected in the series after re-running the worksheet, and there doesn't appear to be any errors in the Java
        Plugin or Collaborator.logs, then close out of the worksheet completely and try to re-run the worksheet one more time.  If the update is then reflected
        that that usually points to a possible issue the last_update_date column and needs to be addressed differently.  It should also be mentioned to Oracle
        Support if this problem with updates only recently started occurring with this series or if this is a new series that is being tested out.


6. Errors with Workflows or Level Methods that call Workflows (ex. Load Scenario Data)

   Although the root cause might lie in another log, the first log that should be checked is the Collaborator.log  This log can be accessed by going to the following URL:

   http://< Host Name of Webserver : Port Number>/demantra/admin/systemLogs.jsp

   So for example if you normally log into Demantra using the following URL:

   http://DEMANTRAMACHINE:8080/demantra/portal/loginpage.jsp

   then these logs would be accessed by going to:

   http://DEMANTRAMACHINE:8080/demantra/admin/systemLogs.jsp

   To make sure you are not looking at older cached  System Logs then press F5 since this is the IE method to refresh the cache.

An alternative way to view these logs is to go directly the machine hosting the webserver and go to the logs found under ...Collaborator\demantra\logs (note that this a Windows Directory path example and Demantra, when deployed on non-Windows boxes, will still be under this folder path but obviously with  different directory navigation steps)

Look for the entries in the log around the time of the error (note that the webserver might be in a different timezone so an error for an enduser in New York at 4pm will show up at 1pm in the Webserver based in California)

   To enable Java console log:
 
   Start ->control Panel ->Java - >Advanced->

   Click for Enable Trace, Enable console and show console option

   Enhanced Logging for Workflow issues can  be recorded by going to:
 
   http://< Host Name of Webserver : Port Number>/demantra/admin/loggerManager.jsp

Once there, turn on any line that has Workflow in it and then re-run the workflow in question.  Note that this logging will be turned off either by the next time the webserver is restarted or by the user turning off the lines that were earlier turned on.

   For v730 and higher these will have check boxes instead of ON/OFF buttons.

  • appserver.workflow.general
  • appserver.workflow.steps
  • appserver.workflow.timing
  • workflow.general


   If the error is in a Transfer step then you might need to consult that Integration Interface logs in the next section of this document.


7. Integration Interface / Transfer Step / APS.bat / APS.exe Errors or Data Issues   

   Although the root cause might lie in another log, the first log that should be checked is the Integration.log  This log can be accessed by going to the following URL:

   http://< Host Name of Webserver : Port Number>/demantra/admin/systemLogs.jsp
 
   So for example if you normally log into Demantra using the following URL:

   http://DEMANTRAMACHINE:8080/demantra/portal/loginpage.jsp

   then these logs would be accessed by going to:

   http://DEMANTRAMACHINE:8080/demantra/admin/systemLogs.jsp

   To make sure you are not looking at older cached System Logs, clear the browser cache:

  • For IE, Hold the Ctrl key and press the F5 key - Or - hold the Ctrl key and click the Refresh button on the toolbar
  • For Mozilla Firefox, hold down the Ctrl key and then press F5 - Or - hold down both the Ctrl and Shift keys and then press R
  • For Chrome Either: Hold the Ctrl key and press F5 - Or - hold the Ctrl key and click Reload button

An alternative way to view these logs is to go directly the machine hosting the webserver and go to the logs found under ...Collaborator\demantra\logs (note that this a Windows Directory path example and Demantra, when deployed on non-Windows boxes, will still be under this folder path but obviously with  different directory navigation steps)

Look for the entries in the log around the time of the error (note that the webserver might be in a different timezone so an error for an enduser in New York at 4pm will show up at 1pm in the Webserver based in California)
 
   Note that errors might also be found in the following tables in the Demantra schema/database:

   - <Integration Interface Table name>_ERR  (ex. if the staging table is name Biio_Supply_Plan then the error table would be Biio_Supply_Plan_Err)

The ERR table mentioned above is checked to see when the record does not make it from the staging table (ex. Biio_Supply_Plan) to the end Demantra table (ex. Sales_Data).  For certain types of integration there might be 4 additional intermediate tables which should also be checked for records being kicked out or else not fully processed.

   They are:

  • UPDATE_BATCH_TRAIL
  • UPDATE_BATCH_VALUES
  • UPDATE_BATCH_TRAIL_ERR
  • UPDATE_BATCH_VALUES_ERR


   Each of the above ERR table will have a message field with at least a brief description of why it was kicked out.


8. Errors with Member Management or Chaining


 

Note that issues with actually launching these two applications from the Collaborator Workbench and other silent installer issues should be addressed by    reviewing Note 947322.1


   Errors that occur in Member Management might be seen by going to Business Modeler -->  Tools --> Procedure Error Log

   Note that this looks to the backend table called db_exception_log
 
   Errors that occur during Chaining* might also be might be seen by going to Business Modeler -->  Tools --> Procedure Error Log

   An additional error message table for Chaining is the Chains_Queue table (can only be viewed by use of SQL commands).

   * It should be noted that this error has to do with when the Status states 'Failed' and is not meant to cover legitimate warning messages like 'No Common
     Population or Source' indicating that the setup of your chaining profile is possibly incorrect.



9. Issues with EBS/ASCP Integration to/from Demantra (ex. Shipment and Bookings, SCI Data, etc..)


   This section talks about troubleshooting integration or data loads that start with the job launching outside of Demantra (ex. Launching the jobs from the Oracle
   EBS Concurrent Request screen such as the Collect Bookings and Shipment History job).   Data Collections, like Load Scenario Data, which is launched directly
   from the Demantra Collaborator Workbench (ex. by right click functionality) should be debugged, at least initially, using the Errors with Workflows or Level
   Methods that call Workflows (ex. Load Scenario Data) section of this note.

   For those persons used to working with Oracle EBS/ASCP applications you know that most jobs  (ex. Collections) can be logged using the steps found in Note 245974.1

However, jobs that directly relate to Demantra (ex. Shipment and Bookings Collection, Load SCI, etc..) can have extra logging turned on by changing MSD_DEM: Debug Mode to Yes (default is No) and MRP DEBUG: Yes at the User level (turn on this logging in both the Source and Destination instances).  

Note that as these jobs move to the other side of the wall from EBS/ASCP to the Demantra side of the database (usually indicated  by when you start seeing references to the Demantra schema or tables like t_src_items_tmpl, t_src_sales_tmpl_err, biio_sci_data, etc.) then these errors may need to be tracked using the Workflow or Active_Proc_Dyn or Demantra specific troubleshooting sections of this note.  

   Review in:

  • Concurrent Request Log/ View Output Log / View Logs
  • Log for the Request_id Log in question
  • Demantra Staging tables and related Err tables
  • apscheck.sql

 


10. Error with Legacy Demantra Scheduler Application (ex. Manuals_Ins, Dynamic_Sync, etc.)

Prior to Demantra Version 6.x, when the application became a Web Based front end application, clients would have used a native Demantra application, commonly referred to as Scheduler, to run various stored procedures at set intervals.  The most important of these jobs was the Manuals_Ins stored procedure which pre-dates the asynchronous Java Updater (the latter which came into the application starting in v7.x).  Errors on the Scheduler, usually indicated by a Red Stripe over the job on the application interface, can be tracked by going to the logs found under the ..Demand Planner\Scheduler\bin folder on the machine where the Scheduler is running.


 
11. EP_LOAD PROPORT and MORE Can Use LOG_IT to Enhance Log File Information

 

  • LOG_IT is a logging mechanism for Demantra PL/SQL database procedure code.  It is analogous to log4j in Java.
  • LOG_IT can be used to trace a procedure flow, show variable values and record performance timing without having to run a debugger.
  • LOG_IT is only available for a limited number of procedures like CHAINING, PROPORT, SIMULATION, EP_LOAD, ADD_MISSING_DEFAULT_ROWS and more.  The list keeps growing.

    The available procedures are listed in the LOG_IT_PARAMS table.

    See Note 1408753.1 for details regarding LOG_IT.


Summary

In summary, most clients who have the Scheduler running at their site are going to be pre-Version 6.x clients but we might have some clients on the latest versions of Demantra continuing to run it due to Bug 6439497.  Jobs that are running in the Scheduler should be ported over to the Demantra Workflow schedule by the client or consultant and given the same schedule run times and frequency as in the current Scheduler.  Note that Dynamic_Sync and Manuals_Ins however serve no purpose in v7.x versions of Demantra and higher and should not be ported over to the Workflow.

REFERENCES

NOTE:1675117.1 - Demantra Topical and Procedural Debugging Using Log Files and Key Troubleshooting Techniques Including LOG_IT and the NEW SET_LOG_IT_LOGGING Procedure
NOTE:947322.1 - Step by Step Troubleshooting of the Silent Installer (opening up the Business Modeler, Chaining, or Member Management links from the Demantra Collaborator Workbench)
NOTE:1481533.1 - Oracle Demantra v7.3.1.4 to v12.2 Installation Guide to Simplify Installation Process Using Weblogic
NOTE:1952102.1 - Demantra Debugging, Error Location, Log File Location, Log Files by Process, Patch, Patching
NOTE:848205.1 - No Demantra Forecast Generated - Common Issues
NOTE:1408753.1 - Demantra LOG_IT Setup Execution Explanation ORA Errors Detailed Log Production + New SET_LOG_IT_LOGGING Procedure
NOTE:1614966.1 - Oracle Demantra Development strongly suggests all customers uptake this critical patch. Patch 17808535. Critical Internal Processing Patch
NOTE:1086704.1 - Demantra Engine on Linux or Unix Failure Hanging Error Not Starting Debugging Install and Configuration Checklist

Demantra Topical and Procedural Debugging Using Log Files and Key Troubleshooting Techniques Including LOG_IT and the NEW SET_LOG_IT_LOGGING Procedure (Doc ID 1675117.1)

 In this Document

Purpose
Questions and Answers
 Default Log Location
 
You can also set log levels at runtime with the following URL:
  http://Demantra_root/Collaborator/virtual_directory /admin/loggerManager.jsp


Web Application, Client and Network troubleshooting
 
Application out of memory errors
 
Server side issues
 
Client side issues
 
Network
 
Data Model - LOG_IT
 
Data Loading - LOG_IT
 
Ep_Load performance
 
Data Loading, Integration
 
Integration Performance
 
DB deadlock/ internal database error
 
WS performance and errors
 Client side issues
 
Engine errors
 
Engine Processor Error or Performance
 
Configure auditing capabilities for BM configuration changes
 Key Oracle Demantra Support Notes/Web Cast Materials
References

APPLIES TO:

Oracle Demantra Demand Management - Version 7.3.1 and later
Information in this document applies to any platform.

PURPOSE

 To provide a general guide or matrix of available Demantra logs by topical area and procedure.

QUESTIONS AND ANSWERS

Default Log Location

is the Demantra_root/Collaborator/virtual_directory/portal/logs directory.
Review the comments in the Demantra_root/Collaborator/virtual_directory/portal/conf/logconf.lcf  file to specify this log file information:

  • Name and location
  • Maximum size of the log file
  • Number to keep
  • Log categories and log level


You can also set log levels at runtime with the following URL:
  http://Demantra_root/Collaborator/virtual_directory /admin/loggerManager.jsp


Web Application, Client and Network troubleshooting

  • Demantra Web application includes 3 components:
    • Application Server, web application deployment inside a Web server
    • Client Memory, CPU and a fragmented slow hard drive
    • Network


For better troubleshooting we need to understand where we have a problem is it on the Server side, Client side, Network or all three

  • Verify proper memory availability for both
  • Verify excessive memory usage for both


Demantra Web application deployment inside a Web server

  • Client
    • User side browser and resources; CPU, Memory and available disk space, running Java Plug-in
  • Are you connected by a Network (LAN, WAN...)
  • For better troubleshooting we need to understand where we have a problem is it on the Server side, Client side, Network or all three


Application out of memory errors

  • Application server memory configuration (-Xmx)
    • Identify where the problem is by using logs:
      • Collaborator log
        • server side log
      • Plug-in log
        • Client side log


Server side issues

  • Heap dump from the webserver
  • Thread dump from the Webserver
    • In case of application freeze or slow down
  • Application server memory configuration (-Xmx)
  • Count of Level members
    • Need level member caching?


Client side issues

  • User side browser and resources (CPU, Memory) running SUN Java Plug-in
  • Heap dump from the Java plug-in
  • Thread dump from the Java plug-in
  • Plug-in memory configuration (-Xmx)


Network

  • Netstat
  • Oracle TNS Logging
    • See Demantra Engine on Linux or Unix Failure Hanging Error Not Starting Debugging Install and Configuration Checklist, Document 1086704.1
  • SQL*Net log


When having installation errors there are a few files that can be analyzed

  • Installer log
  • Screen shots of the selections in the different Installer panels
  • Review db_audit_log table for object changes made by the upgrade DB_Exception_Log table


Data Model - LOG_IT

  • When having data model errors there are few files that can be analyzed
    • An Export of the Data model
    • Review db_audit_log table for object changes made by the upgrade
    • LOG_DATA_MODEL table, an automatic LOG_IT log
    • See LOG_IT Reference Link Below


Data Loading - LOG_IT

  • Ep_Load, Ep_load Errors
    • Enable LOG_IT process on relevant Demantra stored procedures as defined in LOG_IT_PARAMS table
    • See note Demantra LOG_IT Setup Execution Explanation ORA Errors Detailed Log Production, Document 1408753.1
    • DB_Exception_Log
    • See LOG_IT Reference Link Below


Ep_Load performance

  • Count of data from the staging tables
    • Based on the number of rows and the limitations of hardware, are expections realistic
  • DB_Params table
    • Ep_Load performance related parameters
  • Execute the Call_DM_Build_Procedures after changing parallelization parameters in DB_Params
  • DB Hardware definition parameters
  • Are they set according to recommendations of manufacturer, RDBMS and application?
  • System Memory Disk IO and CPU Utilization monitoring
    • Either system performance monitor or Linux top events
  • AWR /ADDM reports


Data Loading, Integration

  • Integration Errors:
    • Collaborator and Integration log
      • Enable sql logging: appserver.sql, appserver.update.sql
    • Concurrent request logs
      • collaborator.login.user
  • apscheck.sql, See Document 246150.1


Integration Performance

  • Count of data from the staging tables
  • APS_Params
    • Integration Interface related parameters
  • DB HW definitions
  • System memory disk IO and CPU utilization monitoring
    • either system performance monitor or Linux top events
  • AWR/ADDM reports


DB deadlock/ internal database error

  • Collaborator.log
  • Database \ udump logs
    • USER_DUMP_DEST specifies the pathname for a directory where the DB server will write debugging trace files on behalf of a user process
  • Enable LOG_IT process on selected Demantra stored procedures as defined in LOG_IT_Params table


WS performance and errors

  • Identify where the problem is:
    • Client side
      • CPU utilization (and for how long)
    • Server side issues:
      • AWR /ADDM reports, DB side CPU and Memory.  Application server CPU and configuration, APS_PARAMS relevant parameters
      • Demantra Index Advisor report
      • Thread dump (in case of application freeze or slow down)
    • System Memory Disk IO and CPU Utilization monitoring
      • either system performance monitor or Linux top events
    • DB HW definitions
    • Number of concurrent users at the time, concurrent user log
    • Also see Oracle Demantra Worksheets Caching, Details how the Caching Functionality can be Leveraged to Potentially Reduce Performance, Document 1627652.1

 

Client side issues

  • Plug-in –Xmx setting
  • WS wizard panels screen shots
  • Client side log
    • If requested, Number of combinations in the WS


Engine errors

  • Always provide a full Engine log (manager and engine) with relevant logging option
  • DB errors
    • As found in the RDBMS Alert Log
    • As found in the db_exception_log
  • Engine log with Sql logging
    • depends on where the DB error is Engine manager or engine2k
    • Demantra Engine2k Log File Analysis Engine Performance Optimization, Document 1458866.1
    • Troubleshooting Guide for the Demantra Engine Issues, Document 1456714.1


Engine Processor Error or Performance

  • Engine log with DebugPro logging’ groups 100/110
  • Engine Out of memory errors
  • No of Tasks
  • Count of Active Combinations (Select Count(1) from MDP_Matrix where prediction_status = 1)
    • See Demantra Investigate Sales, Combinations, Levels and Prediction Status Using SQL, Document 1503990.1
    • See Troubleshooting Guide for the Demantra Engine Issues, Document 1456714.1
  • Engine not running
    • On Linux
      • Application server log
  • Engine performance
  • AWR report
  • Check whether CPU Hyper threading enabled on Engine servers
    • Disable if its enabled
    • Engine Blades/Server + DB HW definitions
  • DB/Engine Blades Memory Disk IO and CPU Utilization Monitoring
    • Either system performance monitor or Linux top events
  • For more information check Oracle Support Document 800030.1 "Demantra Engine Troubleshooting” Presentation (April 6th, 2011)


Configure auditing capabilities for BM configuration changes

  • This is a customization enhancement introduced by DEV application team in a Technical Brief (“Implementing Demantra Audit log”)
    • Configuring an Audit Log in Demantra Using Database Triggers, Document 1629974.1
      • Currently captures Inserts/ Updates on Sessions/Computed_fields tables by a trigger based process
  • The mechanism and idea can easily be enhanced for further Metadata audit opportunities
  • Difference from BAL diff
    • This mechanism captures all the changes, not just how the latest change differs between schemas
  • The logs are kept in a separate table (AUDIT_LOG ), so no impact on the out of the box schema
  • AUDIT_LOG table includes the following information (columns):
    • log_date
    • session_id
    • os_user
    • host_name
    • module
    • user_id
    • object_type
    • object_name
    • old_value
    • new_value
    • Message

Key Oracle Demantra Support Notes/Web Cast Materials

  • Oracle Demantra Documentation Library, Document 443969.1
  • Demantra Development Suggested Performance Advice plus Refernece doc, Document 1157173.1
  • Trouble Shooting the Demantra Worksheet Performance 7.3 and Beyond! UPDATED! Document 470852.1
  • Demantra Development Suggested Performance Advice Plus Reference Docs, Document 1157173.1
  • Rebuild_Schema procedure - One of the Keys to Improved Demantra performance, Document 860576.1
  • Step by Step Troubleshooting of the Silent Installer, Document 947322.1
  • Additional Configurations needed when Running Demantra on Oracle 11g Databases, Document 1064995.1
  • How to Analyze Demantra Forecast Engine Performance (Processing Time) Issues / Demantra Engine is Slow, Document 863025.1
  • Improving Demantra Engine Performance of Resetting Previous Forecast For Inactive Combinations, Document 1270690.1
  • Step by Step Troubleshooting of the Silent Installer, Document 947322.1
  • Additional Configurations needed when Running Demantra on Oracle 11g Databases, Document 1064995.1
  • How to check Demantra Performance. Troubleshooting. Database. Maintenance. Parameters. Java. Worksheet. Engine, Document 1356886.1
  • Web Cast Materials, Document 800030.1
  • Key Logs When Troubleshooting Demantra Issues - From Installation to Operations, Document 741464.1
  • Demantra LOG_IT Setup Execution Explanation ORA Errors Detailed Log Production Document 1408753.1

 

 

REFERENCES

NOTE:741464.1 - Key Logs When Troubleshooting Demantra Issues - From Installation to Operations
NOTE:1408753.1 - Demantra LOG_IT Setup Execution Explanation ORA Errors Detailed Log Production + New SET_LOG_IT_LOGGING Procedure
NOTE:1246024.1 - How to Obtain a Thread Dump (Stack Traces) From a Java Process or Core File of a Java Process on Windows
NOTE:947322.1 - Step by Step Troubleshooting of the Silent Installer (opening up the Business Modeler, Chaining, or Member Management links from the Demantra Collaborator Workbench)
NOTE:1064995.1 - Additional Configurations needed when Running Demantra on Oracle 11g Databases to Avoid ORA-24247: network access denied by access control list (ACL)
NOTE:863025.1 - How to Analyze Demantra Forecast Engine Performance (Processing Time) Issues / Demantra Engine is Slow
NOTE:443969.1 - Oracle Demantra: Documentation, Release Notes, Transfer of Information (TOI), and Training
NOTE:1157173.1 - Demantra Primary Note: Essential Development Suggested Performance Advice Plus Reference Docs
NOTE:800030.1 - Demantra Solutions Advisor Webcast Calendar And Archive
NOTE:470852.1 - Oracle Demantra Worksheet Performance - A Technical Paper
NOTE:860576.1 - Rebuild_Schema procedure - One of the Keys to Improved Demantra performance
NOTE:1270690.1 - Improving Demantra Engine Performance of Resetting Previous Forecast For Inactive Combinations
NOTE:1356886.1 - How to check Demantra Performance DataBase and Worksheet Parameters

Key Logs When Troubleshooting Demantra Issues - From Installation to Operations (Doc ID 741464.1)

 In this Document

Purpose
Scope
Details
 
1. Installation of the Demantra Base Application, Patches or Version Upgrades
 2. Error starting the Web Server and/or deploying the Demantra WAR file
 3. Error logs for the Demantra forecast engine - batch or simulation
 
4. Stored procedure errors with Active_Proc_Dyn somewhere in the error message
 5. End user errors, when they occur in a Demantra worksheet, or when end user updates appear not to be processed or saved correctly.
 
6. Errors with Workflows or Level Methods that call Workflows (ex. Load Scenario Data)
 
7. Integration Interface / Transfer Step / APS.bat / APS.exe Errors or Data Issues   
 
8. Errors with Member Management or Chaining
 

9. Issues with EBS/ASCP Integration to/from Demantra (ex. Shipment and Bookings, SCI Data, etc..)
 
10. Error with Legacy Demantra Scheduler Application (ex. Manuals_Ins, Dynamic_Sync, etc.)


Configuration and Troubleshooting Demantra and 12c In Memory Columns and Tables for Faster Read Transactions. Release 12.2.5.1 and Above. Known Issues, Monitoring+! (Doc ID 2126233.1)

 In this Document

Abstract
History
Details
Summary
 Configuration
 Troubleshooting

APPLIES TO:

Oracle Demantra Demand Management - Version 12.2.5.1 and later
Information in this document applies to any platform.

ABSTRACT

Demantra, starting from version 12.2.5.1, is certified to work with Oracle DB 12c. 

 

  • This DB version includes the ability to load data into memory to enable faster read transactions from the database; this provides a significant performance gain on some of the Demantra operations, mainly worksheet run time.

HISTORY

Created 13-Apr-2016. 

DETAILS

The following guidelines and suggestions have been compiled based on internal work done by Oracle Demantra Development team, as well as real customer experience with this capability and configuration.

SUMMARY

Configuration

Oracle 12c allows the capability of bringing to memory columns or tables, the recommendation is not to load complete tables to memory, like mdp_matrix and data tables.  But rather load relevant columns from mdp_matrix and the data tables, sales_data as an example, for a DM solution.

It is important to remember that loading data into memory will improve the performance of read transaction, but is less relevant for insert/update transactions.

Therefore while discussing the columns that need to be loaded to memory, we can ignore engine / data loading processes and focus mainly on worksheets and export needs.

Relevant columns for these types of operations can be identified by analyzing the SQLs the application is generating while loading the worksheets used by the users and in the export process.

If your data table is partitioned, it is also recommended to load columns only on relevant partitions, and not just load the full columns to memory from all available partitions.

The suggested options when loading columns to memory are:
InMemory Compress – use the option “For Query Low” – this means less compression and better performance, if you need to compress the data more, you can use the option “For Query High”.
Priority – you should load the columns into memory with priority set to “Critical”

As part of the notes mechanism of Demantra, some mdp_matrix columns are added to the SQL queries, these are columns like IS_PROMOTION, IS_SUPPLY_PLAN, IS_SCENARIO_RESOURCE , IS_T_EP_CTO and more.

  • This will need to be fixed in future releases, but currently, for achieving the desired performance gains, these columns will need to be loaded to memory as well. The full list should be obtained by analyzing the queries SQLs.

 

Troubleshooting

1. To monitor the status of IMCS build-up, use the following query:

  

select inst_id, owner||'.'||segment_name segment_name,partition_name,populate_status status
, round(sum(INMEMORY_SIZE)/1024/1024,2) im_size_mb
, round(MAX(BYTES)/1024/1024,2) disk_size_mb
, round(sum(BYTES_NOT_POPULATED)/1024/1024,2) not_mb
, count(*)
, '1:'||round(MAX(BYTES)/sum(INMEMORY_SIZE),1) as compress_ratio
from gv$im_segments
group by inst_id, owner,segment_name,partition_name,populate_status
order by segment_name, inst_id, partition_name;

 

  •  Note that only when the status = COMPLETED the actual IMCS load is done.

Other two useful SQL statements that complete the IM segments status are:

  

select 'TABLE' as object_type,owner||'.'||table_name as object_name,
inmemory,
inmemory_priority,
inmemory_distribute,
inmemory_compression,
inmemory_duplicate
from dba_tables
where inmemory is not null
and (inmemory <> 'DISABLED' or inmemory is null)
UNION
select 'PARTITION',table_owner||'.'||table_name||' Part: '||partition_name as table_name,
inmemory,
inmemory_priority,
inmemory_distribute,
inmemory_compression,
inmemory_duplicate
from dba_tab_partitions
where inmemory is not null
and (inmemory <> 'DISABLED' or inmemory is null)
order by object_type desc,object_name;

  

SELECT owner,
table_name,
segment_column_id,
column_name,
inmemory_compression
FROM v$im_column_level
WHERE inmemory_compression <> 'NO INMEMORY'
ORDER BY owner,table_name,column_name;

 

  

2. In some versions of 12c we have encountered an ORA-01795: maximum number of expressions in a list is 1000 - error while trying to load into memory data from partitioned table, this is a known DB defect 19670592 : ORA-1795 ON QUERYING AN IN MEMORY TABLE WITH MORE THAN 1000 PARTITIONS , and if you do encounter this problem, there is a need to log a DB SR to get a one off (or get instructions of the bundle patch with this fix).

3. Additional DB patch may be needed to resolve a problem where for few tables and partitions “populate_status” is not getting updated.  This is fixed by defect BUG 18549042 - THE STATUS OUT OF MEMORY IS NOT SHOW IN VIEW V$IM_SEGMENTS.

4. We are seeing cases where although sales_data columns are in memory, the DB is using the table and indexes on sales_data and not the in-memory columns; this is an issue we are still exploring to understand the root cause.

Database Options/Management Packs Usage Reporting for Oracle Databases 11.2 and later (Doc ID 1317265.1)

  Database Options/Management Packs Usage Report You can determine whether an option is currently in use in a database by running options_pa...