Issue

Unable to start BI Scheduler and while starting the BI services using the following command

/app/APPLTOP/instance/BIInstance/bin/opmnctl startall

---------------------------------+--------------------+---------+---------

ias-component                    | process-type       |     pid | status

---------------------------------+--------------------+---------+---------

coreapplication_obips1           | OracleBIPresentat~ |    4175 | Alive

essbaseserver1                   | Essbase            |     N/A | Down

coreapplication_obiccs1          | OracleBIClusterCo~ |    4176 | Alive

coreapplication_obisch1          | OracleBIScheduler~ |   15885 | Down

coreapplication_obijh1           | OracleBIJavaHostC~ |    4174 | Alive

coreapplication_obis1            | OracleBIServerCom~ |    4171 | Alive

Error Reported

After a lot of research I could find the following error clearly reported under 'nqscheduler.log' file. Notice the last few lines (highlighted in bold) for the root cause of this error:

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\NumGlobalRetries not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\MinGlobalSleepSecs not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\MaxGlobalSleepSecs not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\NumRequestRetries not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\MinRequestSleepSecs not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\MaxRequestSleepSecs not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\NumDeliveryRetries not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\MinDeliverySleepSecs not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\MaxDeliverySleepSecs not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\Debug not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\KeepErrorLogFiles not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\LogMailContent not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\MaxRowsTimesColumns not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\Generate7BitPlainText not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value iBots\ForceUTF8 not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value Workflow\Server not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value Workflow\System not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value Workflow\Service not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value Mail\SmtpCaCertificateFile not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value Mail\SmtpCaCertificateDirectory not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [WARNING:1] [] [] [ecid: ] [tid: 601e1700]  [67004] Configuration value Mail\SmtpCipherList not set.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: ] [tid: 601e1700]  [nQSError: 46073] Operation 'open()' on file '/app/APPLTOP/instance/BIInstance/tmp/OracleBISchedulerComponent/coreapplication_obisch1/obis_temp/NQTransMgrTemp.rpd.Log' failed with error: (13) x¨øRÿ.

[2014-05-15T04:43:07.000-04:00] [OracleBISchedulerComponent] [ERROR:1] [] [] [ecid: ] [tid: 601e1700]  [68008] Scheduler Error: [nQSError: 46073] Operation 'open()' on file '/app/APPLTOP/instance/BIInstance/tmp/OracleBISchedulerComponent/coreapplication_obisch1/obis_temp/NQTransMgrTemp.rpd.Log' failed with error: (13) x¨øRÿ.

Cause of Issue

The WebLogic Server and BI services have been started as the root user and caused some files to get root ownership.

This caused most services to fail when started as the common user (the user that originally did the install) as this user could not access some of the files with root ownership.

The files that were affected could be found with the following command, issued from the <oracle home> for the WebLogic Server and OBIEE install:

ls -lR |awk '{print $3" "$4" "$9}' |grep root

here the first column shows the ownership, the second column the group and third column the filename).

If you find files listed with 'root' user and group 'root' then that's where the problem lies.

Solution

1. Change the ownership of all files in the middleware home containing the WebLogic Server and OBIEE install back to the the user under which they were installed. Similarly, change the group back to the original group.

2. For example, in my case the original user was "fusion" and group was "dba", and the BI server was installed under the directory "/app/APPLTOP/instance"

chown -R oracle *

chgrp -R oinstall *

3. Now start your services one by one using ompnctl command:

/app/APPLTOP/instance/BIInstance/bin/opmnctl startproc ias-component=coreapplication_obisch1

/app/APPLTOP/instance/BIInstance/bin/opmnctl startproc ias-component=essbaseserver1

4. Check your server status now and all should be under 'Alive' status:

/app/APPLTOP/instance/BIInstance/bin/opmnctl status

Processes in Instance: BIInstance

---------------------------------+--------------------+---------+---------

ias-component                    | process-type       |     pid | status

---------------------------------+--------------------+---------+---------

coreapplication_obips1           | OracleBIPresentat~ |    4175 | Alive

essbaseserver1                   | Essbase            |   16139 | Alive

coreapplication_obiccs1          | OracleBIClusterCo~ |    4176 | Alive

coreapplication_obisch1          | OracleBIScheduler~ |   15885 | Alive

coreapplication_obijh1           | OracleBIJavaHostC~ |    4174 | Alive

coreapplication_obis1            | OracleBIServerCom~ |    4171 | Alive

Environment

• Oracle Fusion Applications 11.1.7
• Linux 5.7 x86-64