TheECLWatchMan.xml 69 KB

12345678910111213141516171819202122232425262728293031323334353637383940414243444546474849505152535455565758596061626364656667686970717273747576777879808182838485868788899091929394959697989910010110210310410510610710810911011111211311411511611711811912012112212312412512612712812913013113213313413513613713813914014114214314414514614714814915015115215315415515615715815916016116216316416516616716816917017117217317417517617717817918018118218318418518618718818919019119219319419519619719819920020120220320420520620720820921021121221321421521621721821922022122222322422522622722822923023123223323423523623723823924024124224324424524624724824925025125225325425525625725825926026126226326426526626726826927027127227327427527627727827928028128228328428528628728828929029129229329429529629729829930030130230330430530630730830931031131231331431531631731831932032132232332432532632732832933033133233333433533633733833934034134234334434534634734834935035135235335435535635735835936036136236336436536636736836937037137237337437537637737837938038138238338438538638738838939039139239339439539639739839940040140240340440540640740840941041141241341441541641741841942042142242342442542642742842943043143243343443543643743843944044144244344444544644744844945045145245345445545645745845946046146246346446546646746846947047147247347447547647747847948048148248348448548648748848949049149249349449549649749849950050150250350450550650750850951051151251351451551651751851952052152252352452552652752852953053153253353453553653753853954054154254354454554654754854955055155255355455555655755855956056156256356456556656756856957057157257357457557657757857958058158258358458558658758858959059159259359459559659759859960060160260360460560660760860961061161261361461561661761861962062162262362462562662762862963063163263363463563663763863964064164264364464564664764864965065165265365465565665765865966066166266366466566666766866967067167267367467567667767867968068168268368468568668768868969069169269369469569669769869970070170270370470570670770870971071171271371471571671771871972072172272372472572672772872973073173273373473573673773873974074174274374474574674774874975075175275375475575675775875976076176276376476576676776876977077177277377477577677777877978078178278378478578678778878979079179279379479579679779879980080180280380480580680780880981081181281381481581681781881982082182282382482582682782882983083183283383483583683783883984084184284384484584684784884985085185285385485585685785885986086186286386486586686786886987087187287387487587687787887988088188288388488588688788888989089189289389489589689789889990090190290390490590690790890991091191291391491591691791891992092192292392492592692792892993093193293393493593693793893994094194294394494594694794894995095195295395495595695795895996096196296396496596696796896997097197297397497597697797897998098198298398498598698798898999099199299399499599699799899910001001100210031004100510061007100810091010101110121013101410151016101710181019102010211022102310241025102610271028102910301031103210331034103510361037103810391040104110421043104410451046104710481049105010511052105310541055105610571058105910601061106210631064106510661067106810691070107110721073107410751076107710781079108010811082108310841085108610871088108910901091109210931094109510961097109810991100110111021103110411051106110711081109111011111112111311141115111611171118111911201121112211231124112511261127112811291130113111321133113411351136113711381139114011411142114311441145114611471148114911501151115211531154115511561157115811591160116111621163116411651166116711681169117011711172117311741175117611771178117911801181118211831184118511861187118811891190119111921193119411951196119711981199120012011202120312041205120612071208120912101211121212131214121512161217121812191220122112221223122412251226122712281229123012311232123312341235123612371238123912401241124212431244124512461247124812491250125112521253125412551256125712581259126012611262126312641265126612671268126912701271127212731274127512761277127812791280128112821283128412851286128712881289129012911292129312941295129612971298129913001301130213031304130513061307130813091310131113121313131413151316131713181319132013211322132313241325132613271328132913301331133213331334133513361337133813391340134113421343134413451346134713481349135013511352135313541355135613571358135913601361136213631364136513661367136813691370137113721373137413751376137713781379138013811382138313841385138613871388138913901391139213931394139513961397139813991400140114021403140414051406140714081409141014111412141314141415141614171418141914201421142214231424142514261427142814291430143114321433143414351436143714381439144014411442144314441445144614471448144914501451145214531454145514561457145814591460146114621463146414651466146714681469147014711472147314741475147614771478147914801481148214831484148514861487148814891490149114921493149414951496149714981499150015011502150315041505150615071508150915101511151215131514151515161517151815191520152115221523152415251526152715281529153015311532153315341535153615371538153915401541154215431544154515461547154815491550155115521553155415551556155715581559156015611562156315641565156615671568156915701571157215731574157515761577157815791580158115821583158415851586158715881589159015911592159315941595159615971598159916001601160216031604160516061607160816091610161116121613161416151616161716181619162016211622162316241625162616271628162916301631163216331634163516361637163816391640164116421643164416451646164716481649165016511652165316541655165616571658165916601661166216631664166516661667166816691670167116721673167416751676167716781679168016811682168316841685168616871688168916901691169216931694169516961697169816991700170117021703170417051706170717081709171017111712171317141715171617171718171917201721172217231724172517261727172817291730173117321733173417351736173717381739174017411742174317441745174617471748174917501751175217531754175517561757175817591760176117621763176417651766176717681769177017711772177317741775177617771778177917801781178217831784178517861787178817891790179117921793179417951796179717981799180018011802180318041805180618071808180918101811181218131814181518161817181818191820182118221823182418251826182718281829183018311832183318341835
  1. <?xml version="1.0" encoding="UTF-8"?>
  2. <!DOCTYPE book PUBLIC "-//OASIS//DTD DocBook XML V4.5//EN"
  3. "http://www.oasis-open.org/docbook/xml/4.5/docbookx.dtd">
  4. <book xml:base="../">
  5. <title>Using ECL Watch</title>
  6. <bookinfo>
  7. <title>Using ECL Watch</title>
  8. <mediaobject>
  9. <imageobject>
  10. <imagedata fileref="images/redswooshWithLogo3.jpg" />
  11. </imageobject>
  12. </mediaobject>
  13. <author>
  14. <surname>Boca Raton Documentation Team</surname>
  15. </author>
  16. <legalnotice>
  17. <para>We welcome your comments and feedback about this document via
  18. email to <email>docfeedback@hpccsystems.com</email></para>
  19. <para>Please include <emphasis role="bold">Documentation
  20. Feedback</emphasis> in the subject line and reference the document name,
  21. page numbers, and current Version Number in the text of the
  22. message.</para>
  23. <para>LexisNexis and the Knowledge Burst logo are registered trademarks
  24. of Reed Elsevier Properties Inc., used under license.</para>
  25. <para>HPCC Systems<superscript>®</superscript> is a registered trademark
  26. of LexisNexis Risk Data Management Inc.</para>
  27. <para>Other products, logos, and services may be trademarks or
  28. registered trademarks of their respective companies.</para>
  29. <para>All names and example data used in this manual are fictitious. Any
  30. similarity to actual persons, living or dead, is purely
  31. coincidental.</para>
  32. <para></para>
  33. </legalnotice>
  34. <xi:include href="common/Version.xml"
  35. xpointer="xpointer(//*[@id='FooterInfo'])"
  36. xmlns:xi="http://www.w3.org/2001/XInclude" />
  37. <xi:include href="common/Version.xml"
  38. xpointer="xpointer(//*[@id='DateVer'])"
  39. xmlns:xi="http://www.w3.org/2001/XInclude" />
  40. <corpname>HPCC Systems<superscript>®</superscript></corpname>
  41. <xi:include href="common/Version.xml"
  42. xpointer="xpointer(//*[@id='Copyright'])"
  43. xmlns:xi="http://www.w3.org/2001/XInclude" />
  44. <mediaobject role="logo">
  45. <imageobject>
  46. <imagedata fileref="images/LN_Rightjustified.jpg" />
  47. </imageobject>
  48. </mediaobject>
  49. </bookinfo>
  50. <chapter id="ECLWatch_Intro">
  51. <title>Introducing ECL Watch</title>
  52. <para>ECL Watch is a service that runs on the Enterprise Services Platform
  53. (ESP), a middleware component on the HPCC Platform.</para>
  54. <para>ECL Watch provides an interface to the HPCC system and allows you to
  55. view information and interrogate nodes to confirm all expected processes
  56. are running. It is a plugin that is useful for Systems Administrators to
  57. check processes, examine topology, and view logs. It is useful to ECL
  58. Programmers to monitor the status of jobs and files, and other pertinent
  59. information. This provides a simple view into the system and a means to
  60. perform Workunit and data files maintenance.</para>
  61. <para>The ECL Watch interface is a browser based set of pages where you
  62. can access and interface with the HPCC System. To Run <emphasis
  63. role="bold">ECL Watch</emphasis> using you browser, go to the node on your
  64. system running <emphasis role="bold">ESP/ECL Watch</emphasis> on port
  65. 8010. For example, http://nnn.nnn.nnn.nnn:8010, where nnn.nnn.nnn.nnn is
  66. your ESP/ECL Watch node's IP address. This will launch ECL Watch.</para>
  67. <para>ECL Watch is organized by categories based on several system
  68. functions. These functions or actions are accessible through the links
  69. along the top of the main home page. However there are several ECL Watch
  70. items with common functionality universally across pages of ECL
  71. Watch.</para>
  72. <sect1 id="Common_Elements">
  73. <title>Common Elements</title>
  74. <para>There are common elements that are useful anywhere within ECL
  75. Watch.</para>
  76. <sect2 id="OpenInNewPage">
  77. <title>Open in New Page</title>
  78. <para>The <emphasis role="bold">Open in New Page</emphasis> link
  79. allows you to open a new window directly to the item which you are
  80. viewing. <figure>
  81. <title>Open in New Page</title>
  82. <mediaobject>
  83. <imageobject>
  84. <imagedata fileref="images/ECLWA500.jpg" />
  85. </imageobject>
  86. </mediaobject>
  87. </figure></para>
  88. <para>Opening a new page of the current view is useful in several
  89. ways:</para>
  90. <itemizedlist>
  91. <listitem>
  92. <para><emphasis role="bold">Open in New Page</emphasis> is a
  93. shareable link. Right-click on <emphasis role="bold">Open in New
  94. Page</emphasis> and select <emphasis>Copy link address</emphasis>
  95. from the context menu. You can now save, share, or send that link
  96. and the recipient can open a window directly to the (new)
  97. page.</para>
  98. </listitem>
  99. <listitem>
  100. <para>New pages maintain filter states. If you have set a filter
  101. and share that link, the new page has the same filter set.</para>
  102. </listitem>
  103. <listitem>
  104. <para>The new page is live. (If that page has auto-refresh
  105. enabled) The recipient doesn't need to reset the page or refresh
  106. to see current state.</para>
  107. </listitem>
  108. </itemizedlist>
  109. </sect2>
  110. <sect2 id="ListWidgets">
  111. <title>List widgets</title>
  112. <para><figure>
  113. <title>List Widgets</title>
  114. <mediaobject>
  115. <imageobject>
  116. <imagedata fileref="images/ECLWA-Comm.jpg" />
  117. </imageobject>
  118. </mediaobject>
  119. </figure></para>
  120. <para>ECL Watch commonly displays items in the forms of a list. Lists
  121. of workunits, lists of logical files, lists of Roxie queries, etc. The
  122. following elements in ECL Watch work on any list widget:</para>
  123. <para><itemizedlist>
  124. <listitem>
  125. <para>Download as CSV (Workunits, DFU Workunits, Logical files,
  126. and Roxie queries)</para>
  127. </listitem>
  128. <listitem>
  129. <para>Column check box. Select all rows by selecting the check
  130. box at top (Use Shift+Click to select a range)</para>
  131. </listitem>
  132. <listitem>
  133. <para>Sort by column header. Click on the column header to sort
  134. that column according to that column's contents.</para>
  135. </listitem>
  136. <listitem>
  137. <para>Resize Column Widths by dragging the borders.</para>
  138. </listitem>
  139. <listitem>
  140. <para>Filters that allow you to set criteria for the items to
  141. display in the list.</para>
  142. </listitem>
  143. </itemizedlist></para>
  144. <sect3>
  145. <title>List Filters</title>
  146. <para>Filter options on a list allow you to use specified criteria
  147. to set what you display in the list. Press the <emphasis
  148. role="bold">Filter</emphasis> action button to display the filter
  149. options. When you specify any Filter options, the Filter action
  150. button changes and then displays <emphasis role="bold">Filter
  151. Set</emphasis> and the filter indicator image lights up. When you
  152. then copy an <emphasis role="bold">Open in New Page</emphasis> link
  153. with the filter set, the filter condition persists. Filter
  154. conditions limit the results displayed until you clear the
  155. filter.</para>
  156. </sect3>
  157. </sect2>
  158. <sect2 id="ECLWA_BannerItems">
  159. <title>Banner Items</title>
  160. <para>The banner area of ECL Watch appears at the top of all
  161. pages.</para>
  162. <sect3 id="ECLWAtchHomeButton">
  163. <title>Home Button</title>
  164. <para>The HPCC Systems home button is also the main Activity menu
  165. link. More than just a decoration the home ECL Watch button actually
  166. opens up the Activity page, discussed in more detail in the ensuing
  167. chapter.</para>
  168. <para>The icons to the left of the home button are links to
  169. different areas of ECL Watch. Each of the link areas are discussed
  170. in subsequent chapters.</para>
  171. </sect3>
  172. <sect3 id="MonitorIndicatorLight">
  173. <title>Monitor indicator light</title>
  174. <para>The Monitor indicator light is used to provide an at a glance
  175. snapshot of your overall system health. If you have monitoring and
  176. reporting configured (see <emphasis>HPCC Monitoring and
  177. Reporting</emphasis>) then this light will display a color based on
  178. the the overall (configurable) system health. The light is black if
  179. there is no monitoring or reporting configured for your
  180. system.</para>
  181. </sect3>
  182. <sect3 id="DownloadAsCSV">
  183. <title>Download as CSV</title>
  184. <para>With most lists in ECL Watch you have the ability to download
  185. selected rows as a CSV formatted file. You can then open the CSV
  186. file in any spreadsheet application which supports CSV
  187. format.</para>
  188. </sect3>
  189. </sect2>
  190. <sect2 id="ECLWatch_GlobalSearch">
  191. <title>Global Search</title>
  192. <para>The global search box can be found on the navigation bar at the
  193. top of the ECL Watch page.<figure>
  194. <title>Global Search box</title>
  195. <mediaobject>
  196. <imageobject>
  197. <imagedata fileref="images/ECLWA008.jpg" />
  198. </imageobject>
  199. </mediaobject>
  200. </figure></para>
  201. <para>You can search ECL Workunits, DFU Workunits, Logical Files, and
  202. Queries using the global search box. The global search box also
  203. supports using wildcards. To limit or filter your search results you
  204. can use keywords as displayed in the empty search box.</para>
  205. <para><variablelist>
  206. <varlistentry>
  207. <term>file:</term>
  208. <listitem>
  209. <para>Preface the search string with
  210. <emphasis>file:</emphasis> to search Logical Files.</para>
  211. </listitem>
  212. </varlistentry>
  213. <varlistentry>
  214. <term>wuid:</term>
  215. <listitem>
  216. <para>Preface the search string with
  217. <emphasis>wuid:</emphasis> to search only Workunit ids.</para>
  218. </listitem>
  219. </varlistentry>
  220. <varlistentry>
  221. <term>ecl:</term>
  222. <listitem>
  223. <para>Preface the search string with <emphasis>ecl:</emphasis>
  224. to search only the ECL workunits.</para>
  225. </listitem>
  226. </varlistentry>
  227. <varlistentry>
  228. <term>dfu:</term>
  229. <listitem>
  230. <para>Preface the search string with <emphasis>dfu:</emphasis>
  231. to search only DFU workunits.</para>
  232. </listitem>
  233. </varlistentry>
  234. <varlistentry>
  235. <term>query:</term>
  236. <listitem>
  237. <para>Preface the search string with
  238. <emphasis>query:</emphasis> to search only published
  239. queries.</para>
  240. </listitem>
  241. </varlistentry>
  242. </variablelist>Examples of using the global search:</para>
  243. <para>Enter <emphasis>W201510*</emphasis> into the search box, and it
  244. will return all of the workunits from October 2015.</para>
  245. <para>Enter <emphasis>file:keys</emphasis> into the search box, and it
  246. will return all of the logical files that contain "keys". <figure>
  247. <title>Global Search Example</title>
  248. <mediaobject>
  249. <imageobject>
  250. <imagedata fileref="images/ECLWA015.jpg" />
  251. </imageobject>
  252. </mediaobject>
  253. </figure></para>
  254. <!-- Enter <i>ecl:output</i> into the global search box and it will return all of the workunits that contain "output" in the ECL page of ECL Watch-->
  255. </sect2>
  256. <sect2>
  257. <title>Advanced Menu</title>
  258. <para>There is a section at the top right on the navigation bar with
  259. some useful information and features. This section shows you who you
  260. are logged in as (if your system has authentication enabled). The
  261. Advanced menu is located on the right hand side of the navigation bar.
  262. There are several items that you can access from the advanced
  263. menu.</para>
  264. <para><figure>
  265. <title>Advanced menu</title>
  266. <mediaobject>
  267. <imageobject>
  268. <imagedata fileref="images/ECLWA007b.jpg" />
  269. </imageobject>
  270. </mediaobject>
  271. </figure></para>
  272. <para>There may be a number displayed on the menu link. A number
  273. displayed next to it indicates how many errors and warnings have been
  274. generated during your session. Click on the advanced menu to display a
  275. list of features.</para>
  276. <sect3 id="ECLWatch_AdvancedMenuAccess">
  277. <title>Access the Advanced menu</title>
  278. <para>You access the advanced menu items from the advanced menu link
  279. at the top right corner of ECL Watch.<!--Removed some content stashed in GitStash : ECLWA-1115.xml others culled stored in git-br H8872-NewestECLfor50 **--></para>
  280. <para>The <emphasis role="bold">Set Banner</emphasis> link allows
  281. you to set a custom banner message at the top of your browser window
  282. when you open ECL Watch. You can use this feature to send messages
  283. to users.</para>
  284. <para>The <emphasis role="bold">Error/Warning(s)</emphasis> link
  285. displays a tab showing you Errors, Warnings, and Information
  286. messages. You can filter this page by checking the boxes at the
  287. bottom of the tab. A copy facility is also provided.</para>
  288. <para>The <emphasis role="bold">Release Notes</emphasis> link opens
  289. a new browser tab to the HPCC release notes page where you can find
  290. more release specific information about the contents of each version
  291. of HPCC.</para>
  292. <para>The <emphasis role="bold">Documentation</emphasis> link opens
  293. a new browser tab to the HPCC documentation page, where you can view
  294. and download the HPCC system documentation.</para>
  295. <para>The <emphasis role="bold">Downloads</emphasis> link opens a
  296. new browser tab to the HPCC downloads page, where you can find and
  297. download the HPCC Platform, Client Tools, and Plugins.</para>
  298. <para>The <emphasis role="bold">Additional Resources</emphasis> link
  299. opens a submenu that provides links to areas on the HPCC Systems web
  300. site where you can find additional resources, such as the <emphasis
  301. role="bold">Red Book</emphasis>, <emphasis role="bold">User
  302. Forums</emphasis>, <emphasis role="bold">Issue Reporting</emphasis>,
  303. and the <emphasis role="bold">Transition Guide</emphasis>.</para>
  304. <para>The <emphasis role="bold">Configuration</emphasis> link opens
  305. for viewing the XML version of the configuration file in use on your
  306. system.</para>
  307. <para>The <emphasis role="bold">About</emphasis> link opens a dialog
  308. to display some information about the version of the HPCC platform
  309. and graph controls installed on your server.</para>
  310. </sect3>
  311. <sect3 id="ECLWatch_AdvancedMenuLoggedInAs" role="nobrk">
  312. <title>Logged In As</title>
  313. <para>The <emphasis role="bold">Logged In As:</emphasis> link at the
  314. top of the ECL Watch page displays information about the current
  315. user on a cluster configured for authentication. <figure>
  316. <title>Logged In As</title>
  317. <mediaobject>
  318. <imageobject>
  319. <imagedata fileref="images/ECLWMyAccount.jpg" />
  320. </imageobject>
  321. </mediaobject>
  322. </figure></para>
  323. <para><orderedlist>
  324. <listitem>
  325. <para>Click on the <emphasis role="bold"><emphasis
  326. role="bold">LOGGED IN AS:</emphasis></emphasis> link.</para>
  327. <para>The User Details window opens. The default window opens
  328. on the Summary tab.</para>
  329. <para><figure>
  330. <title>User Details window</title>
  331. <mediaobject>
  332. <imageobject>
  333. <imagedata fileref="images/ECLWA474.jpg" />
  334. </imageobject>
  335. </mediaobject>
  336. </figure></para>
  337. </listitem>
  338. <listitem>
  339. <para>From The User Details page Summary tab, you can Confirm
  340. the User Name that you are logged in as.</para>
  341. <para>You can change your password.</para>
  342. <para>Note that Administrator rights are needed to manage
  343. users and permissions.</para>
  344. <para>Ensure you are using an account with Administrator
  345. rights if you intend to manage users or permissions.</para>
  346. </listitem>
  347. <listitem>
  348. <para>Verify the password expiration date, or if password is
  349. set to expire.</para>
  350. </listitem>
  351. </orderedlist></para>
  352. <sect4 id="ECLWatch_AdvancedMenuChangePassword" role="nobrk">
  353. <title>Change Password</title>
  354. <para>If authentication is enabled on your HPCC system, you can
  355. change your password, right from the User Details window.
  356. <orderedlist>
  357. <listitem>
  358. <para>Click on the <emphasis role="bold"><emphasis
  359. role="bold">LOGGED IN AS:</emphasis></emphasis> link.</para>
  360. <para>The User Details window opens. The default window
  361. opens on the Summary tab. There are fields on the Summary
  362. tab where you can change your password.</para>
  363. </listitem>
  364. <listitem>
  365. <para>Enter your desired new password.</para>
  366. <para>Make sure it meets whatever criteria your system may
  367. have for passwords.</para>
  368. </listitem>
  369. <listitem>
  370. <para>Confirm your new password.</para>
  371. <para>Make sure that it matches the password you entered in
  372. the previous field.</para>
  373. </listitem>
  374. <listitem>
  375. <para>Press the Save button. It is in the upper left portion
  376. of the window.</para>
  377. </listitem>
  378. </orderedlist></para>
  379. </sect4>
  380. <sect4 id="ECLWatch_AdvancedMenuPermissionGroups">
  381. <title>Permission groups</title>
  382. <para>The second tab on the User Details window labelled Member
  383. Of, displays a list of groups. The groups your account belongs to,
  384. are indicated with a checkmark.</para>
  385. <para>You must be an administrator to modify any of group
  386. settings.</para>
  387. </sect4>
  388. <sect4 id="ECLWatch_AdvancedMenuUserPermissions">
  389. <title>User Permissions tab</title>
  390. <para>The third tab on the User Details window labelled <emphasis
  391. role="bold">User Permissions</emphasis>, displays a list of
  392. permission settings. Note that Administrator rights are needed to
  393. manage users and permissions. Ensure you are using an account with
  394. Administrator rights if you intend to manage users or
  395. permissions.</para>
  396. <para>This is where you can access the user permissions area. A
  397. more detailed description of the user permissions settings is
  398. covered in the <link linkend="User_Permissions_Chapter">User
  399. Permissions</link> section.</para>
  400. </sect4>
  401. </sect3>
  402. </sect2>
  403. </sect1>
  404. </chapter>
  405. <chapter id="ECLWatch_Home_Chapter">
  406. <title>ECL Watch Home Page</title>
  407. <para>Click on the <emphasis role="bold">ECL Watch</emphasis> home page
  408. link in the navigation bar at the top of the ECL Watch page to find the
  409. <emphasis role="bold">Activity</emphasis>, <emphasis
  410. role="bold">Scheduler</emphasis>, and <emphasis role="bold">Search
  411. Results</emphasis> links. You can access the respective pages from the
  412. links or tabs along the top of the ECL Watch home page.</para>
  413. <para><figure>
  414. <title>ECL Watch home page link</title>
  415. <mediaobject>
  416. <imageobject>
  417. <imagedata fileref="images/ECLWA010.jpg" vendor="eclwatchSS" />
  418. </imageobject>
  419. </mediaobject>
  420. </figure></para>
  421. <para>There are several icons used throughout ECL Watch. The following
  422. table describes most of the icons that you will encounter.</para>
  423. <para><informaltable colsep="1" frame="all">
  424. <tgroup cols="2">
  425. <colspec colwidth="46pt" />
  426. <tbody>
  427. <row>
  428. <entry><emphasis role="bold">Icon</emphasis></entry>
  429. <entry><emphasis role="bold">Definition</emphasis></entry>
  430. </row>
  431. <row>
  432. <entry><inlinegraphic fileref="images/ECLWaCluster.png"
  433. vendor="eclwatchSS" /></entry>
  434. <entry>System cluster</entry>
  435. </row>
  436. <row>
  437. <entry><inlinegraphic fileref="images/ECLWaClustPaused.png"
  438. vendor="eclwatchSS" /></entry>
  439. <entry>System cluster paused</entry>
  440. </row>
  441. <row>
  442. <entry><inlinegraphic fileref="images/ECLWaClustNotFound.png"
  443. vendor="eclwatchSS" /></entry>
  444. <entry>System cluster not found</entry>
  445. </row>
  446. <row>
  447. <entry><inlinegraphic fileref="images/wu_complete.png"
  448. vendor="eclwatchSS" /></entry>
  449. <entry>Workunit Compiled, Completed</entry>
  450. </row>
  451. <row>
  452. <entry><inlinegraphic fileref="images/wu_running.png"
  453. vendor="eclwatchSS" /></entry>
  454. <entry>Workunit Running, Compiling, Debug Running</entry>
  455. </row>
  456. <row>
  457. <entry><inlinegraphic fileref="images/wu_fail.png"
  458. vendor="eclwatchSS" /></entry>
  459. <entry>Workunit Failed, Aborted</entry>
  460. </row>
  461. <row>
  462. <entry><inlinegraphic fileref="images/wu_warn.png"
  463. vendor="eclwatchSS" /></entry>
  464. <entry>Workunit Blocked, Scheduled, Wait, Uploading Files, Debug
  465. Paused, Paused</entry>
  466. </row>
  467. <row>
  468. <entry><inlinegraphic fileref="images/wu_archived.png"
  469. vendor="eclwatchSS" /></entry>
  470. <entry>Workunit Archived</entry>
  471. </row>
  472. <row>
  473. <entry><inlinegraphic fileref="images/wu_abort.png"
  474. vendor="eclwatchSS" /></entry>
  475. <entry>Workunit Aborting</entry>
  476. </row>
  477. <row>
  478. <entry><inlinegraphic fileref="images/wu_submit.png"
  479. vendor="eclwatchSS" /></entry>
  480. <entry>Workunit Submitted</entry>
  481. </row>
  482. <row>
  483. <entry><inlinegraphic fileref="images/wu_deleted.png"
  484. vendor="eclwatchSS" /></entry>
  485. <entry>Workunit Deleted.</entry>
  486. </row>
  487. <row>
  488. <entry><inlinegraphic fileref="images/workunit.png"
  489. vendor="eclwatchSS" /></entry>
  490. <entry>Workunit Unknown State</entry>
  491. </row>
  492. </tbody>
  493. </tgroup>
  494. </informaltable></para>
  495. <sect1 id="ECLWatch_Activity" role="nobrk">
  496. <title>Activity</title>
  497. <para>The Activity tab displays activity on all clusters in the
  498. environment. The Activity page provides access to Cluster Job Queue
  499. administration tasks such as: monitoring progress, setting priority,
  500. moving a job up or down in the queue, pausing a job, aborting a job, and
  501. pausing or resuming a queue.</para>
  502. <!--***Note specific Activity task details have been REMOVED (to DocShare/WKSPCE/ECLWa400)***-->
  503. <para>When you access the ECL Watch URL, the ECL Watch Home Page
  504. displays the Activity tab. To access the Activity tab from any other
  505. page in ECL Watch click on the <emphasis role="bold">ECL
  506. Watch</emphasis> image at the top of any page, as shown above.</para>
  507. <sect2 id="ECLWatch_ClusterActivity">
  508. <title>Cluster Activity</title>
  509. <para>Information about your systems' clusters, and any activity on
  510. those clusters can be accessed from the ECL Watch Activity tab. Select
  511. the <emphasis role="bold">Activity</emphasis> tab link below the
  512. <emphasis role="bold">ECL Watch</emphasis> image in the navigation
  513. sub-menu. This displays the Cluster Activity tab.</para>
  514. <para><figure>
  515. <title>Clusters Activity</title>
  516. <mediaobject>
  517. <imageobject>
  518. <imagedata fileref="images/ECLWA1002b.jpg" vendor="eclwatchSS" />
  519. </imageobject>
  520. </mediaobject>
  521. </figure></para>
  522. <para>All the system clusters display. If there is any activity on a
  523. cluster there is an icon next to the cluster to indicate some
  524. activity. In the above example the icon to expand the Thor cluster
  525. indicates there is some activity on the Thor cluster. Click the icon
  526. to expand the cluster to see the activity on that cluster.</para>
  527. </sect2>
  528. <sect2 role="brk">
  529. <title>Cluster Action Buttons</title>
  530. <figure>
  531. <title>Cluster Action Buttons</title>
  532. <mediaobject>
  533. <imageobject>
  534. <imagedata fileref="images/ECLWA1005.jpg" vendor="eclwatchSS" />
  535. </imageobject>
  536. </mediaobject>
  537. </figure>
  538. <para>Check the box next to a cluster to enable the Cluster Action
  539. buttons. The Cluster Action buttons will then allow you to perform the
  540. following actions on the selected cluster's job queue.</para>
  541. <sect3>
  542. <title>Pause</title>
  543. <para>Pauses the cluster's job queue. The currently running job will
  544. complete, but no other jobs will execute until the queue is
  545. resumed.</para>
  546. </sect3>
  547. <sect3>
  548. <title>Resume</title>
  549. <para>Resumes a paused job queue. Any waiting jobs will resume
  550. execution in order.</para>
  551. </sect3>
  552. <sect3>
  553. <title>Clear</title>
  554. <para>Removes all workunits from the job queue. The removed
  555. workunits' state is then set to aborted. Any workunits that were
  556. waiting in the queue can be resubmitted manually later, if
  557. desired.</para>
  558. </sect3>
  559. </sect2>
  560. <sect2 id="WorkUnitActivityTab">
  561. <title>Cluster Workunit Activity</title>
  562. <para><figure>
  563. <title>Workunit Activity Buttons</title>
  564. <mediaobject>
  565. <imageobject>
  566. <imagedata fileref="images/ECLWA1002c.jpg" vendor="eclwatchSS" />
  567. </imageobject>
  568. </mediaobject>
  569. </figure></para>
  570. </sect2>
  571. <sect2>
  572. <title>Workunit Action Buttons</title>
  573. <para>Check the box next to a Workunit to select it and enable the
  574. Workunit Action buttons.</para>
  575. <para>The enabled Workunit Action buttons will then allow you to
  576. perform the following actions on the selected Workunit(s).</para>
  577. <sect3>
  578. <title>Open</title>
  579. <para>Opens a (workunit) tab for the selected workunit.</para>
  580. </sect3>
  581. <sect3>
  582. <title>Pause</title>
  583. <para>Press the <emphasis role="bold">Pause</emphasis> button to
  584. complete the current subgraph and then put the job into a paused
  585. state.</para>
  586. </sect3>
  587. <sect3>
  588. <title>Pause Now</title>
  589. <para>Press the <emphasis role="bold">Pause Now</emphasis> button to
  590. interrupt the current subgraph (abort it) and put the job into a
  591. paused state.</para>
  592. </sect3>
  593. <sect3>
  594. <title>Resume</title>
  595. <para>Resumes processing of any paused job.</para>
  596. </sect3>
  597. <sect3>
  598. <title>Abort</title>
  599. <para>Aborts a running job. An aborted job cannot be resumed.</para>
  600. </sect3>
  601. <sect3>
  602. <title>High, Normal, Low</title>
  603. <para><figure>
  604. <title>Priority</title>
  605. <mediaobject>
  606. <imageobject>
  607. <imagedata fileref="images/ECLWA1003b.jpg" />
  608. </imageobject>
  609. </mediaobject>
  610. </figure>You can raise or lower the priority of the job in the
  611. queue. Select the job, then press one of the appropriate buttons,
  612. <emphasis role="bold">High</emphasis> or <emphasis
  613. role="bold">Low</emphasis>. Typically all jobs are Normal priority
  614. by default.</para>
  615. <para>Press the <emphasis role="bold">High</emphasis> button to
  616. raise the priority of the select job to High. Press the <emphasis
  617. role="bold">Low</emphasis> button to lower the priority of the
  618. processing job.</para>
  619. </sect3>
  620. <sect3>
  621. <title>Top, Bottom, Up, Down</title>
  622. <para><figure>
  623. <title>Queue Position</title>
  624. <mediaobject>
  625. <imageobject>
  626. <imagedata fileref="images/ECLWA1003c.jpg" />
  627. </imageobject>
  628. </mediaobject>
  629. </figure>You can change the position of a job in the queue using
  630. the Top, Bottom, Up, and Down buttons.</para>
  631. <para>Select the workunit to move, that will enable the action
  632. buttons.</para>
  633. <para>Press the <emphasis role="bold">Top</emphasis> button to move
  634. the select job to the top of the processing queue. Press the
  635. <emphasis role="bold">Up</emphasis> button to move the job up one
  636. position in the queue. Press the <emphasis
  637. role="bold">Down</emphasis> button to move the job down one position
  638. in the queue. Press the <emphasis role="bold">Bottom</emphasis>
  639. button to move the job down to the bottom of the queue.</para>
  640. </sect3>
  641. </sect2>
  642. <sect2 id="cluster_Info" role="brk">
  643. <title>Cluster Information</title>
  644. <para>You can access more information about your Thor clusters from
  645. the main Activity tab.</para>
  646. <para>Select the target cluster from the main <emphasis
  647. role="bold">Activity</emphasis> tab, by checking the box next to it.
  648. <figure>
  649. <title>Open Cluster</title>
  650. <mediaobject>
  651. <imageobject>
  652. <imagedata fileref="images/ECLWA002.jpg" />
  653. </imageobject>
  654. </mediaobject>
  655. </figure></para>
  656. <para>This enables the <emphasis role="bold">Open</emphasis> action
  657. button. Press the Open action button to open a new tab for that
  658. cluster.</para>
  659. <para>The cluster tab displays the groups on that cluster. Check the
  660. box next to the cluster group, and press the open button. <figure>
  661. <title>Open Cluster Groups</title>
  662. <mediaobject>
  663. <imageobject>
  664. <imagedata fileref="images/ECLWA003.jpg" />
  665. </imageobject>
  666. </mediaobject>
  667. </figure></para>
  668. <para>Open up the cluster group tab (for example, mythor), and select
  669. the group from the Groups tab to see the activity information on that
  670. cluster group. <figure>
  671. <title>Cluster Activity tabs</title>
  672. <mediaobject>
  673. <imageobject>
  674. <imagedata fileref="images/ECLWA004.jpg" />
  675. </imageobject>
  676. </mediaobject>
  677. </figure></para>
  678. <para>On that cluster group tab, you can access the information about
  679. that cluster. There are three tabs on that cluster group tab. The
  680. <emphasis role="bold">Summary</emphasis> tab provides a snapshot of
  681. that group.</para>
  682. <para>Alternatively, you can click the link on the cluster name to
  683. examine.</para>
  684. <sect3 id="ClusterUsageTab">
  685. <title>The Cluster Usage Tab</title>
  686. <para>The <emphasis role="bold">Usage</emphasis> tab provides access
  687. to a usage graph. The usage tab provides information about the
  688. cluster usage. <figure>
  689. <title>Usage Graph</title>
  690. <mediaobject>
  691. <imageobject>
  692. <imagedata fileref="images/ECLWA0UG01.jpg" />
  693. </imageobject>
  694. </mediaobject>
  695. </figure></para>
  696. <para>To display the usage graph, you can enter some values in the
  697. in the fields displayed on the initial usage tab. Optionally, you
  698. can just accept the default, the values for the last 30 days. Then
  699. press the <emphasis role="bold">Get Usage Graph</emphasis> button to
  700. display the graph.</para>
  701. <para>The Graph shows the cluster usage over time. More information
  702. about the cluster usage is specified using a color code. The column
  703. on the right breaks down the overall usage as well as the percentage
  704. during standard business hours and non-business hours. You can
  705. change these values using the fields above the chart, then press the
  706. <emphasis role="bold">Get Usage Graph</emphasis> button
  707. again.</para>
  708. <sect4>
  709. <title id="ClusterLogFile">Cluster Log File</title>
  710. <para>The <emphasis role="bold">Log File</emphasis> tab is where
  711. you can view that cluster group's log. <figure>
  712. <title>Cluster Log File</title>
  713. <mediaobject>
  714. <imageobject>
  715. <imagedata fileref="images/ECLWA005.jpg" />
  716. </imageobject>
  717. </mediaobject>
  718. </figure></para>
  719. <para>There are several log display options that you can use to
  720. filter the log file. You can filter by rows, pages, or by time.
  721. Use the filter options on the Log File tab to filter the displayed
  722. log. You can also download the log file to view offline.</para>
  723. </sect4>
  724. </sect3>
  725. </sect2>
  726. <sect2 id="ECLWatch_AutoRefresh">
  727. <title>Auto Refresh</title>
  728. <para><figure>
  729. <title>Auto Refresh</title>
  730. <mediaobject>
  731. <imageobject>
  732. <imagedata fileref="images/ECLWA011.jpg" />
  733. </imageobject>
  734. </mediaobject>
  735. </figure>The <emphasis role="bold">Activity</emphasis> page displays
  736. active ECL or DFU workunits either running or in the queue on your
  737. cluster. To refresh the list, press the <emphasis
  738. role="bold">Refresh</emphasis> button. Auto Refresh shows the list in
  739. real-time, but this feature is disabled by default.</para>
  740. <para>To enable Auto Refresh, toggle the Auto Refresh button.</para>
  741. <para>In an environment with a large number of active users, Auto
  742. Refresh could impact performance of your ESP server.</para>
  743. </sect2>
  744. </sect1>
  745. <sect1 id="ECLWatch_EventScheduler">
  746. <title>ECL Event Scheduler</title>
  747. <para>The Event Scheduler page provides an interface to the ECL
  748. Scheduler. The ECL Scheduler interface allows you to see a list of
  749. scheduled workunits. It can also trigger an event. An Event is a
  750. case-insensitive string constant naming the event to trap.</para>
  751. <para>ECL Scheduling provides a means of automating processes within ECL
  752. code or to chain processes together to work in sequence. For example,
  753. you can write ECL code that watches a landing zone for the arrival of a
  754. file, and when it arrives, sprays it to Thor, processes it, builds an
  755. index, and then adds it to a superfile.</para>
  756. <para>ECL Scheduling is event-based. The ECL Scheduler monitors a
  757. Schedule list containing registered Workunits and Events and executes
  758. any Workunits associated with an Event when that Event is
  759. triggered.</para>
  760. <para>Your ECL Code can execute when an Event is triggered, or can
  761. trigger an Event. If you submit code containing a <emphasis
  762. role="bold">WHEN </emphasis>clause, the Event and Workunit registers in
  763. the Schedule list. When that Event triggers, the Workunit compiles and
  764. executes. When the Workunit completes, ECL Scheduler removes it from the
  765. Schedule list.</para>
  766. <para>For example, if you submit a Workunit using <emphasis
  767. role="bold">WHEN(‘Event1’,’MyEvent’, COUNT(2)) </emphasis>in the
  768. appropriate place, it will execute twice (the value of <emphasis
  769. role="bold">COUNT</emphasis>) before the ECL Scheduler removes it from
  770. the Schedule list and the Workunit is marked as completed.</para>
  771. <para>For more details about both <emphasis id="WHEN"
  772. role="bold">WHEN</emphasis> or <emphasis id="NOTIFY"
  773. role="bold">NOTIFY</emphasis> or any ECL Language functions or keywords
  774. please see the ECL Language reference. A copy of which can be found
  775. online at <ulink
  776. url="http://hpccsystems.com/download/docs/learning-ecl">http://hpccsystems.com/download/docs/learning-ecl</ulink>
  777. on the HPCC Systems<superscript>®</superscript> web site.</para>
  778. <!--***NOTE: Be sure to UPDATE these images when they find a home in ECLWATCH***-->
  779. </sect1>
  780. <xi:include href="ECLScheduler/ECLSched-Mods/ECLSchedComp.xml"
  781. xpointer="xpointer(//*[@id='ECLSched_Interface'])"
  782. xmlns:xi="http://www.w3.org/2001/XInclude" />
  783. </chapter>
  784. <chapter id="ECLWatch_ECLWorkunits">
  785. <title>ECL Workunits</title>
  786. <para>ECL Watch provides information about ECL jobs and workunits. Links
  787. to pages that contain information about ECL workunits appear in the
  788. navigation bar along top of the ECL Watch page. There you will find links
  789. to ECL Workunits, simply labelled as Workunits, and you will also find the
  790. link to the ECL Playground. Not only can you find information about
  791. workunits there, but you can perform operations on workunits.</para>
  792. <xi:include href="ECLWatch/ECLWa_mods/ECLWatchSrc.xml"
  793. xpointer="xpointer(//*[@id='ECLWorkunits'])"
  794. xmlns:xi="http://www.w3.org/2001/XInclude" />
  795. <xi:include href="ECLPlayground/ECLPlay-Mods/ECL_Playground.xml"
  796. xpointer="xpointer(//*[@id='ECL_Playground'])"
  797. xmlns:xi="http://www.w3.org/2001/XInclude" />
  798. </chapter>
  799. <chapter id="ECLWatch_FilesChapter">
  800. <title>Files</title>
  801. <para>This chapter contains sections dealing with HPCC Platform Files,
  802. found on the <emphasis role="bold">Files</emphasis> link in ECL
  803. Watch.</para>
  804. <para>In an HPCC platform, data files are partitioned across nodes. The
  805. file parts, referenced using Logical Filenames, are stored in the
  806. Distributed File Utility. This allows the collection of file parts to be
  807. referenced as a single entity.</para>
  808. <xi:include href="ECLWatch/ECLWa_mods/ECLWatchSrc.xml"
  809. xpointer="xpointer(//*[@id='ECLWatchLogicalFiles'])"
  810. xmlns:xi="http://www.w3.org/2001/XInclude" />
  811. <xi:include href="ECLWatch/ECLWa_mods/ECLWatchSrc.xml"
  812. xpointer="xpointer(//*[@id='DFUWorkunits'])"
  813. xmlns:xi="http://www.w3.org/2001/XInclude" />
  814. <xi:include href="ECLWatch/ECLWa_mods/ECLWatchSrc.xml"
  815. xpointer="xpointer(//*[@id='Landing_Zones'])"
  816. xmlns:xi="http://www.w3.org/2001/XInclude" />
  817. <sect1 id="spray_and_despray">
  818. <title>Spray/Despray</title>
  819. <para>This section details how to Spray and Despray a data file to your
  820. cluster using ECL Watch. The spray function is integrated into the
  821. Landing Zone page as detailed in the <link linkend="Upload_Files">Upload
  822. Files</link> section .</para>
  823. <para>In order to spray a file to your cluster you must first upload the
  824. file to your landing zone. The file upload steps are detailed in the
  825. preceding section.</para>
  826. <para>With the file successfully uploaded to the landing zone you can
  827. choose the file to spray from the Landing Zone page. Once selected the
  828. Spray buttons become enabled.</para>
  829. <para><figure>
  830. <title>Landing Zone Page</title>
  831. <mediaobject>
  832. <imageobject>
  833. <imagedata fileref="images/ECLWA440.jpg" vendor="eclwatchSS" />
  834. </imageobject>
  835. </mediaobject>
  836. </figure></para>
  837. <sect2 id="Spray-to-cluster">
  838. <title>Spray Data to a Cluster</title>
  839. <para>With the <emphasis role="bold">Spray:</emphasis> Action buttons
  840. enabled, you press the appropriate button for the Spray you wish to
  841. perform. Fill in the appropriate values when prompted to complete the
  842. spray.</para>
  843. </sect2>
  844. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  845. xpointer="xpointer(//*[@id='LZ_Spray'])"
  846. xmlns:xi="http://www.w3.org/2001/XInclude" />
  847. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  848. xpointer="xpointer(//*[@id='Spray_Fixed'])"
  849. xmlns:xi="http://www.w3.org/2001/XInclude" />
  850. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  851. xpointer="xpointer(//*[@id='Spray_Delimited'])"
  852. xmlns:xi="http://www.w3.org/2001/XInclude" />
  853. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  854. xpointer="xpointer(//*[@id='Spray_XML'])"
  855. xmlns:xi="http://www.w3.org/2001/XInclude" />
  856. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  857. xpointer="xpointer(//*[@id='Spray_JSON'])"
  858. xmlns:xi="http://www.w3.org/2001/XInclude" />
  859. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  860. xpointer="xpointer(//*[@id='Spray_Variable'])"
  861. xmlns:xi="http://www.w3.org/2001/XInclude" />
  862. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  863. xpointer="xpointer(//*[@id='Spray_Blob'])"
  864. xmlns:xi="http://www.w3.org/2001/XInclude" />
  865. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  866. xpointer="xpointer(//*[@id='Desprays'])"
  867. xmlns:xi="http://www.w3.org/2001/XInclude" />
  868. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  869. xpointer="xpointer(//*[@id='Copy'])"
  870. xmlns:xi="http://www.w3.org/2001/XInclude" />
  871. <xi:include href="HPCCDataHandling/DH-Mods/DH-Mod1.xml"
  872. xpointer="xpointer(//*[@id='Remote_Copy'])"
  873. xmlns:xi="http://www.w3.org/2001/XInclude" />
  874. </sect1>
  875. <sect1 id="ECLWatch_Xref">
  876. <title>XRef</title>
  877. <para>Under the <emphasis role="bold">Files</emphasis> Icon on the
  878. navigation sub-menu there is a link for XRef. This link will take you to
  879. the XRef page. On the XRef page you can run the XREF utility.</para>
  880. <para><figure>
  881. <title>XRef page</title>
  882. <mediaobject>
  883. <imageobject>
  884. <imagedata fileref="images/ECLWA435.jpg" vendor="eclwatchSS" />
  885. </imageobject>
  886. </mediaobject>
  887. </figure></para>
  888. <sect2 id="The_XREF_Utility">
  889. <title>The XRef Utility</title>
  890. <para>The XREF utility provides the ability to find "orphaned",
  891. "lost", and "found" files. These "orphan" are files which are found on
  892. the nodes but not registered in the Distributed File System.</para>
  893. <variablelist>
  894. <varlistentry>
  895. <term>Found File</term>
  896. <listitem>
  897. <para>A found file has file parts on disk that are not
  898. referenced in the Dali server. All the file parts are accounted
  899. for so they can be added back to the Dali server. They can also
  900. be deleted from the cluster, if required.</para>
  901. </listitem>
  902. </varlistentry>
  903. <varlistentry>
  904. <term>Orphan File</term>
  905. <listitem>
  906. <para>An orphan file is a file without a Dali entry and without
  907. a complete set of physical files. Since some of the physical
  908. files are missing it is an incomplete file and it cannot be used
  909. to add a logical file entry back into the Dali server. These
  910. orphan file parts do not have a reference in the Dali
  911. server.</para>
  912. </listitem>
  913. </varlistentry>
  914. <varlistentry>
  915. <term>Lost File</term>
  916. <listitem>
  917. <para>A logical file that is missing at least one file part on
  918. both the primary and replicated locations in storage. The
  919. logical file is still referenced in the Dali server. Deleting
  920. the file removes the reference from the Dali server and any
  921. remaining parts on disk.</para>
  922. </listitem>
  923. </varlistentry>
  924. </variablelist>
  925. <informaltable colsep="1" frame="all" rowsep="1">
  926. <?dbfo keep-together="always"?>
  927. <tgroup cols="2">
  928. <colspec colwidth="49.50pt" />
  929. <colspec />
  930. <tbody>
  931. <row>
  932. <entry><inlinegraphic fileref="images/tip.jpg" /></entry>
  933. <entry><para>On a large system, we suggest limiting the number
  934. of users who can Generate XREF reports by setting
  935. DfuXrefAccess access to FULL for only those
  936. users.</para><para> </para></entry>
  937. </row>
  938. </tbody>
  939. </tgroup>
  940. </informaltable>
  941. <para>To generate a list:</para>
  942. <itemizedlist>
  943. <listitem>
  944. <para>Press the <emphasis role="bold">Generate</emphasis>
  945. button.</para>
  946. <informaltable colsep="1" frame="all" rowsep="1">
  947. <?dbfo keep-together="always"?>
  948. <tgroup cols="2">
  949. <colspec colwidth="49.50pt" />
  950. <colspec />
  951. <tbody>
  952. <row>
  953. <entry><inlinegraphic fileref="images/tip.jpg" /></entry>
  954. <entry><para>Sasha Server typically runs Xref at the times
  955. scheduled when deployed.</para><para> </para></entry>
  956. </row>
  957. </tbody>
  958. </tgroup>
  959. </informaltable>
  960. </listitem>
  961. </itemizedlist>
  962. <para>To view results:</para>
  963. <itemizedlist>
  964. <listitem>
  965. <para>Click on one of the tabs (Found Files, Orphan Files, Lost
  966. Files, Directories, or Errors/Warnings).</para>
  967. </listitem>
  968. </itemizedlist>
  969. <sect3 id="ECLWatchXREFMultiThor">
  970. <title>XREF with multiple Thor clusters</title>
  971. <para>XREF runs on the primary Thor cluster. For a configuration
  972. with more than one Thor cluster on the same physical node group, ECL
  973. Watch only displays the primary Thor and not any other Thor that
  974. shares the same node group. This is the Thor cluster whose name
  975. matches the <emphasis>nodeGroup</emphasis> in the
  976. configuration.</para>
  977. <para>To allow XREF to run in an environment with multiple Thor
  978. clusters, set the nodeGroup to the same value for all Thor
  979. clusters.</para>
  980. </sect3>
  981. <sect3 id="ECLWatch_WorkingWithXref">
  982. <title>Working with XREF results:</title>
  983. <para>After XRef completes you can see a list of available reports.
  984. Click on one of the tabs to see the results page of each
  985. type.</para>
  986. <figure>
  987. <title>XRef Errors</title>
  988. <mediaobject>
  989. <imageobject>
  990. <imagedata fileref="images/ECLWA435b.jpg" vendor="eclwatchSS" />
  991. </imageobject>
  992. </mediaobject>
  993. </figure>
  994. <para>The Orphan and Lost Files pages list any Orphan or Lost files.
  995. Orphan and Lost files are difficult to recover, unless you have
  996. copies of missing parts needed to reconstruct the file (for example,
  997. if a missing part is on a hard drive that was replaced.)</para>
  998. <figure>
  999. <title>XRef: Delete Orphan Files</title>
  1000. <mediaobject>
  1001. <imageobject>
  1002. <imagedata fileref="images/ECLWA436.jpg" vendor="eclwatchSS" />
  1003. </imageobject>
  1004. </mediaobject>
  1005. </figure>
  1006. <para>Typically, these files will need to be deleted. To Delete,
  1007. check the boxes next to files you want to delete, then press the
  1008. <emphasis role="bold">Delete</emphasis> button.</para>
  1009. <para>Found files can and usually are reattached. <figure>
  1010. <title>XRef: Attach Found Files</title>
  1011. <mediaobject>
  1012. <imageobject>
  1013. <imagedata fileref="images/ECLWA437.jpg" vendor="eclwatchSS" />
  1014. </imageobject>
  1015. </mediaobject>
  1016. </figure></para>
  1017. <para>Check the boxes next to files you want to reattach, then press
  1018. the <emphasis role="bold">Attach</emphasis> button.</para>
  1019. </sect3>
  1020. </sect2>
  1021. </sect1>
  1022. </chapter>
  1023. <chapter id="ECLWatch_Queries">
  1024. <title>Queries</title>
  1025. <para>The link for the Published Queries (icon) header provides more
  1026. information and details about queries on available targets.</para>
  1027. <!-- <para>Include ROXIE (RDDE). List of Clusters.</para>
  1028. <para>Queries &gt; Browse</para>
  1029. <para>Queries &gt; Browse &gt; Thor</para>
  1030. <para>Queries &gt; Browse &gt; Roxie</para>
  1031. <para>Queries &gt; Browse &gt; hThor</para>
  1032. <para>I. Dynamic</para>
  1033. <para>II. Clusters</para> -->
  1034. <para>Click on the Published Queries (icon) hyperlink to display the
  1035. published queries and package maps on that cluster.</para>
  1036. <figure>
  1037. <title>Query Link</title>
  1038. <mediaobject>
  1039. <imageobject>
  1040. <imagedata fileref="images/ECLWA00Q.jpg" vendor="eclwatchSS" />
  1041. </imageobject>
  1042. </mediaobject>
  1043. </figure>
  1044. <xi:include href="ECLWatch/ECLWa_mods/ECLWatchQueries.xml"
  1045. xpointer="xpointer(//*[@id='Queries_Page'])"
  1046. xmlns:xi="http://www.w3.org/2001/XInclude" />
  1047. </chapter>
  1048. <chapter id="ECLWatch_OperationsLink">
  1049. <title>Operations</title>
  1050. <para>The Operations link provides access to several components useful for
  1051. the day-to-day operation of your system, and some system administration
  1052. access as well. <figure>
  1053. <title>Operations Menu</title>
  1054. <mediaobject>
  1055. <imageobject>
  1056. <imagedata fileref="images/ECLWA460.jpg" vendor="eclwatchSS" />
  1057. </imageobject>
  1058. </mediaobject>
  1059. </figure></para>
  1060. <para>There are links to Target Clusters, Cluster Processes, and System
  1061. Servers. These links open pages with more information about the specific
  1062. topology for the selected clusters. These pages are helpful in certifying
  1063. that your system is up and running properly.</para>
  1064. <para>There are also some system administration type links such as, Users,
  1065. Groups, Permissions, and Resources. These links allow you to perform some
  1066. system administration tasks through ECL watch.</para>
  1067. <sect1 id="ECLWatch_Operations_Topology">
  1068. <title>Topology</title>
  1069. <para>The Topology page provides a visual tree display with information
  1070. about your clusters, services, and nodes.</para>
  1071. <para>Click on the <emphasis role="bold">Topology</emphasis> link from
  1072. the Operations navigation sub-menu to access the topology page.</para>
  1073. <para><figure>
  1074. <title>Topology Page</title>
  1075. <mediaobject>
  1076. <imageobject>
  1077. <imagedata fileref="images/ECLWA463.jpg" vendor="ECLWatchSS" />
  1078. </imageobject>
  1079. </mediaobject>
  1080. </figure></para>
  1081. <sect2 id="TopologyTargets" role="brk">
  1082. <title>Targets</title>
  1083. <para>The <emphasis role="bold">Targets</emphasis> Action button
  1084. displays your clusters by type.</para>
  1085. <para>Click on the arrow to the left of the Cluster folder/object to
  1086. expand. The expanded view displays.</para>
  1087. <para><figure>
  1088. <title>Expanded View</title>
  1089. <mediaobject>
  1090. <imageobject>
  1091. <imagedata fileref="images/ECLWA464.jpg" vendor="ECLWatchSS" />
  1092. </imageobject>
  1093. </mediaobject>
  1094. </figure>The expanded view displays the objects and nodes in the
  1095. selected container. Select the node or object to display more
  1096. information or to access the logs. The Summary, Configuration, and Log
  1097. tabs on the left side of the page display the relevant information for
  1098. the selected component.</para>
  1099. </sect2>
  1100. <sect2 id="TopologyServices" role="brk">
  1101. <title>Services</title>
  1102. <para>Press the <emphasis role="bold">Services</emphasis> Action
  1103. button to display information on the various services running on your
  1104. cluster.</para>
  1105. <para>Click on the arrow to the left of the service you wish to
  1106. expand. The expanded view displays.</para>
  1107. <para><figure>
  1108. <title>Expanded Services</title>
  1109. <mediaobject>
  1110. <imageobject>
  1111. <imagedata fileref="images/ECLWA465.jpg" vendor="ECLWatchSS" />
  1112. </imageobject>
  1113. </mediaobject>
  1114. </figure></para>
  1115. <para>The services view provides a service oriented tree view that
  1116. provides access to the services. Expand the tree, and select the
  1117. component to view the Summary, Configuration, or Logs tabs for the
  1118. selected component.</para>
  1119. </sect2>
  1120. <sect2 id="ECLWatch_Operations_TopologyMachines" role="brk">
  1121. <title>Machines</title>
  1122. <para>Press the <emphasis role="bold">Machines</emphasis> Action
  1123. button for more information on the various machines or nodes running
  1124. in your cluster(s).</para>
  1125. <para><figure>
  1126. <title>Machines View</title>
  1127. <mediaobject>
  1128. <imageobject>
  1129. <imagedata fileref="images/ECLWA466.jpg" vendor="ECLWatchSS" />
  1130. </imageobject>
  1131. </mediaobject>
  1132. </figure></para>
  1133. <para>The <emphasis role="bold">Machines</emphasis> action button
  1134. opens a node oriented view of the tree. Expand the nodes to see the
  1135. services on each node. Select the component to view the Summary,
  1136. Configuration, or Logs tabs for that selected component.</para>
  1137. </sect2>
  1138. <sect2 role="brk">
  1139. <title>Roxie File Copy Status</title>
  1140. <para>In the Topology section for Roxie clusters, the <emphasis
  1141. role="bold">Roxie Files Copy Status</emphasis> tab shows the number of
  1142. files a cluster has left to copy.<figure>
  1143. <title>File Copy Status</title>
  1144. <mediaobject>
  1145. <imageobject>
  1146. <imagedata fileref="images/ECLWA467.jpg" vendor="ECLWatchSS" />
  1147. </imageobject>
  1148. </mediaobject>
  1149. </figure></para>
  1150. </sect2>
  1151. </sect1>
  1152. <sect1 id="ECLWatch_Operations_DiskUsage">
  1153. <title>Disk Usage</title>
  1154. <para>When you click on the Operations link, it opens the Disk Usage
  1155. page by default. The Disk Usage page provides information about the
  1156. available space on your system, and what is using that space. <figure>
  1157. <title>Disk Usage</title>
  1158. <mediaobject>
  1159. <imageobject>
  1160. <imagedata fileref="images/ECLWA462.jpg" />
  1161. </imageobject>
  1162. </mediaobject>
  1163. </figure></para>
  1164. <para>You can search or filter the results, using the <emphasis
  1165. role="bold">Filter</emphasis> action button.</para>
  1166. </sect1>
  1167. <sect1 id="ECLWatch_Operations_TargetClusters">
  1168. <title>Operations: Target Clusters</title>
  1169. <para>The Target Clusters link from the navigation sub-menu bar, on the
  1170. Operations page, opens the link to the Target Clusters page. This page
  1171. provides machine information on the clusters you have set up on your
  1172. machine. <figure>
  1173. <title>Target Clusters</title>
  1174. <mediaobject>
  1175. <imageobject>
  1176. <imagedata fileref="images/ECLWA461.jpg" />
  1177. </imageobject>
  1178. </mediaobject>
  1179. </figure></para>
  1180. </sect1>
  1181. <sect1 id="ECLWatch-DynamicESDL">
  1182. <title>Dynamic ESDL</title>
  1183. <para>The Dynamic ESDL tab in ECL Watch displays the available ESP
  1184. Services. You can explore the DESDL services and ESDL bindings, also
  1185. known as service configurations.</para>
  1186. <para>To access Dynamic ESDL through ECL Watch, click on the <emphasis
  1187. role="bold">Operations</emphasis> link, then click on <emphasis
  1188. role="bold">Dynamic ESDL</emphasis> from the navigation sub-menu
  1189. bar.</para>
  1190. <figure>
  1191. <title>Dynamic ESDL sub-menu</title>
  1192. <mediaobject>
  1193. <imageobject>
  1194. <imagedata fileref="images/DESDL03.jpg" />
  1195. </imageobject>
  1196. </mediaobject>
  1197. </figure>
  1198. <para>The <emphasis role="bold">Dynamic ESDL</emphasis> tab contains a
  1199. list of all DESDL based ESP Services and their ESDL Binding information.
  1200. The DESDL-based ESP services available are listed in the navigator pane
  1201. on the left as children of their parent ESP process.</para>
  1202. <para>The <emphasis role="bold">Definitions</emphasis> tab, also
  1203. accessible from the <emphasis role="bold">Dynamic ESDL</emphasis>
  1204. button's sub-menu, lists all available ESDL definitions and provides a
  1205. view into any of the definitions. These definitions are used to
  1206. dynamically define interfaces for existing ESP web services.</para>
  1207. <para>For more information about Dynamic ESDL refer to the
  1208. documentation; <emphasis>Dynamic ESDL</emphasis> available from the HPCC
  1209. Systems portal: <ulink
  1210. url="https://hpccsystems.com/training/documentation/learning-ecl/">https://hpccsystems.com/training/documentation/learning-ecl/dynamic-esdl</ulink></para>
  1211. <sect2 id="USING_Dynamic_ESDL">
  1212. <title>Using Dynamic ESDL</title>
  1213. <para>In order to use this interface choose an ESP service from the
  1214. service list. Click on the triangle icon next to the ESP process to
  1215. expand and display the DESDL services. Select the desired DESDL
  1216. service from the navigator pane.</para>
  1217. <para>The selected service's information displays on the <emphasis
  1218. role="bold">Summary</emphasis> tab to the right.</para>
  1219. <para><figure>
  1220. <title>Dynamic ESDL Summary</title>
  1221. <mediaobject>
  1222. <imageobject>
  1223. <imagedata fileref="images/DESDL08.jpg" />
  1224. </imageobject>
  1225. </mediaobject>
  1226. </figure></para>
  1227. <sect3>
  1228. <title>Viewing the binding information</title>
  1229. <para>If the selected service contains an ESDL binding, you can
  1230. select the binding tab to view the binding definition (the service
  1231. interface) and the configuration information.</para>
  1232. <para>Select the <emphasis role="bold">Binding</emphasis> tab then
  1233. press the <emphasis role="bold">Definition</emphasis> button to
  1234. display the ESDL definition in XML format.</para>
  1235. <para><figure>
  1236. <title>Dynamic ESDL Binding Definition</title>
  1237. <mediaobject>
  1238. <imageobject>
  1239. <imagedata fileref="images/DESDL02.jpg" />
  1240. </imageobject>
  1241. </mediaobject>
  1242. </figure></para>
  1243. </sect3>
  1244. <sect3 id="Configure_ESDL_Bindings">
  1245. <title>Configuring ESDL Bindings</title>
  1246. <para>You can select a service and if there is a binding for it you
  1247. can review, delete, or modify the configuration of that
  1248. binding.</para>
  1249. <para>Press the <emphasis role="bold">Configuration</emphasis>
  1250. button to view or edit the <emphasis role="bold">Method
  1251. Configurations</emphasis>. Press <emphasis
  1252. role="bold">Save</emphasis> when finished. <figure>
  1253. <title>Dynamic EDSL Binding Configuration</title>
  1254. <mediaobject>
  1255. <imageobject>
  1256. <imagedata fileref="images/DESDL04.jpg" />
  1257. </imageobject>
  1258. </mediaobject>
  1259. </figure></para>
  1260. </sect3>
  1261. <sect3>
  1262. <title>Add a Binding</title>
  1263. <para>If a configuration does not have a binding, you can add a
  1264. binding. To add a service binding to an
  1265. <emphasis>unconfigured</emphasis> ESP Service. Select the
  1266. unconfigured ESP service, then press the enabled <emphasis
  1267. role="bold">Add Binding</emphasis> button.</para>
  1268. <para><figure>
  1269. <title>Adding a service binding</title>
  1270. <mediaobject>
  1271. <imageobject>
  1272. <imagedata fileref="images/DESDL05.jpg" />
  1273. </imageobject>
  1274. </mediaobject>
  1275. </figure>This will open a dialog listing the available interfaces
  1276. that have definitions. Select the interface to bind to the ESP
  1277. service.</para>
  1278. <para><figure>
  1279. <title>Adding the definition</title>
  1280. <mediaobject>
  1281. <imageobject>
  1282. <imagedata fileref="images/DESDL06.jpg" />
  1283. </imageobject>
  1284. </mediaobject>
  1285. </figure>Press the <emphasis role="bold">Apply</emphasis> button
  1286. to apply the definition.</para>
  1287. </sect3>
  1288. <sect3>
  1289. <title>Delete a Binding</title>
  1290. <para>To delete a service binding for a
  1291. <emphasis>configured</emphasis> ESP Service. Select the ESP service
  1292. that contains the binding to delete.</para>
  1293. <para><figure>
  1294. <title>Deleting service binding</title>
  1295. <mediaobject>
  1296. <imageobject>
  1297. <imagedata fileref="images/DESDL07.jpg" />
  1298. </imageobject>
  1299. </mediaobject>
  1300. </figure>Press the <emphasis role="bold">Delete Binding</emphasis>
  1301. button. Confirm that you want to delete the binding by pressing OK
  1302. on the confirmation dialog.</para>
  1303. <para>The binding is deleted.</para>
  1304. </sect3>
  1305. </sect2>
  1306. </sect1>
  1307. <xi:include href="HPCCCertify/Cert-Mods/CertPreflight.xml"
  1308. xpointer="xpointer(//*[@id='Preflight_system_servers'])"
  1309. xmlns:xi="http://www.w3.org/2001/XInclude" />
  1310. <xi:include href="HPCCCertify/Cert-Mods/CertPreflight.xml"
  1311. xpointer="xpointer(//*[@id='Preflight_Data_Refinery'])"
  1312. xmlns:xi="http://www.w3.org/2001/XInclude" />
  1313. <!--
  1314. /*commented whole sect out*/
  1315. <sect1 role="nobrk">
  1316. <title>Users</title>
  1317. /*PROBABLY NOT NEEDED - AND CAN BE DELETED*/
  1318. <para>There are User Administration features available through ECL
  1319. Watch. Common system administration tasks are accessible through the
  1320. Operations menu in ECL Watch. The links to Users, Groups, Permissions,
  1321. and Resources allow you to manage these components of your HPCC system
  1322. from the ECL Watch interface.</para>
  1323. <xi:include href="Installing_and_RunningTheHPCCPlatform/Inst-Mods/UserSecurityMaint.xml"
  1324. xpointer="xpointer(//*[@id='Sec_Adm_w_ECLWatch'])"
  1325. xmlns:xi="http://www.w3.org/2001/XInclude" />
  1326. </sect1>
  1327. -->
  1328. </chapter>
  1329. <chapter id="User_Permissions_Chapter">
  1330. <title>Users Permissions</title>
  1331. <sect1 id="ECLWatch_Operations_UserAdministrations" role="nobrk">
  1332. <title>User Administration</title>
  1333. <para>There are User Administration features available through ECL
  1334. Watch.</para>
  1335. <xi:include href="Installing_and_RunningTheHPCCPlatform/Inst-Mods/UserSecurityMaint.xml"
  1336. xpointer="xpointer(//*[@id='Sec_Adm_w_ECLWatch'])"
  1337. xmlns:xi="http://www.w3.org/2001/XInclude" />
  1338. </sect1>
  1339. </chapter>
  1340. <chapter id="Plug-Ins_for_ECLWatch">
  1341. <title>Plugins</title>
  1342. <para>You can add functionality to ECL Watch by installing plugins. These
  1343. plugins are designed to integrate into the ECL Watch interface. After you
  1344. install an approved plugin, the plugin icon displays in the navigation bar
  1345. at the top of the ECL Watch page to provide access to the plugin(s). Click
  1346. on the plugin icon to view the plugins page in ECL Watch. <figure>
  1347. <title>ECL Watch Plugin icon</title>
  1348. <mediaobject>
  1349. <imageobject>
  1350. <imagedata fileref="images/ECLWaPlug.jpg" vendor="VM_welcome" />
  1351. </imageobject>
  1352. </mediaobject>
  1353. </figure></para>
  1354. <sect1 id="Ganglia_in_ECLWatch">
  1355. <title>Ganglia in ECL Watch</title>
  1356. <para>With the HPCC Systems<superscript>®</superscript>
  1357. Ganglia-monitoring plugin installed, you can view the Ganglia statistics
  1358. and graphs through the ECL Watch interface. The default monitoring
  1359. displays several key statistics, but you can customize and configure the
  1360. views.</para>
  1361. <figure>
  1362. <title>Ganglia in ECL Watch</title>
  1363. <mediaobject>
  1364. <imageobject>
  1365. <imagedata fileref="images/GAN051.jpg" vendor="VM_welcome" />
  1366. </imageobject>
  1367. </mediaobject>
  1368. </figure>
  1369. <sect2 id="Customize_Monitoring" role="brk">
  1370. <title>Customize Monitoring</title>
  1371. <para>The default Ganglia page has a tab for Custom Monitoring where
  1372. you can easily add custom monitoring components. <figure>
  1373. <title>Ganglia Custom Monitoring</title>
  1374. <mediaobject>
  1375. <imageobject>
  1376. <imagedata fileref="images/ECLWa481.jpg" vendor="VM_welcome" />
  1377. </imageobject>
  1378. </mediaobject>
  1379. </figure></para>
  1380. <para>To customize the monitoring page;</para>
  1381. <para><orderedlist>
  1382. <listitem>
  1383. <para>Select the <emphasis role="bold">Custom
  1384. Monitoring</emphasis> tab.</para>
  1385. </listitem>
  1386. <listitem>
  1387. <para>Press the <emphasis role="bold">Metrics</emphasis>
  1388. button.</para>
  1389. </listitem>
  1390. <listitem>
  1391. <para>Use the drop menus to display the various graphing
  1392. utilities.</para>
  1393. </listitem>
  1394. </orderedlist></para>
  1395. <para><figure>
  1396. <title>Customize the Metrics</title>
  1397. <mediaobject>
  1398. <imageobject>
  1399. <imagedata fileref="images/ECLWa482.jpg" vendor="VM_welcome" />
  1400. </imageobject>
  1401. </mediaobject>
  1402. </figure></para>
  1403. </sect2>
  1404. <sect2 id="ECLWatch_Monitoring_InstallingGanglia">
  1405. <title>Installing Ganglia in ECL Watch</title>
  1406. <para>In order to use Ganglia in ECL Watch, you need to have Ganglia
  1407. installed on your HPCC System. For details on installing Ganglia for
  1408. ECL Watch, refer to the <emphasis>HPCC Monitoring and
  1409. Reporting</emphasis> manual.</para>
  1410. </sect2>
  1411. </sect1>
  1412. <xi:include href="HPCCMonitoring/MonRep-Mods/NagiosInECLWa.xml"
  1413. xpointer="xpointer(//*[@id='Nagios_in_ECLWatch'])"
  1414. xmlns:xi="http://www.w3.org/2001/XInclude" />
  1415. </chapter>
  1416. <chapter id="Resources">
  1417. <title>Resources</title>
  1418. <para>The resources link can be found under the Operations Icon link. The
  1419. resources link in ECL Watch provides a link to the HPCC
  1420. Systems<superscript>®</superscript> web portal. Visit the HPCC
  1421. Systems<superscript>®</superscript> Web Portal at <ulink
  1422. url="http://hpccsystems.com/">http://hpccsystems.com/</ulink> for software
  1423. updates, plugins, support, documentation, and more. This is where you can
  1424. find resources useful for running and maintaining HPCC on the web
  1425. portal.</para>
  1426. <para>You can also get to the resources link on the HPCC
  1427. Systems<superscript>®</superscript> web portal page, by clicking on the
  1428. <emphasis role="bold">Additional Resources</emphasis> link found on the
  1429. sub-menu of at the top right hand side of navigation bar.</para>
  1430. <para>ECL Watch provides a link to the HPCC portal's download page: <ulink
  1431. url="http://hpccsystems.com/download">http://hpccsystems.com/download</ulink>.
  1432. This is the page where you can download Installation packages, virtual
  1433. images, source code, documentation, and tutorials.</para>
  1434. </chapter>
  1435. </book>