Jump to content

GUI won't display because tokumon errors


Cowboy Denny
 Share

Recommended Posts

I'm running BIG-IQ 8.1.0.2 and this was the solution for me.  I don't take any ownership of results (unless they are good results). :)

 

Are you getting errors in /var/log/tokumon/current that look like this

2022-09-01_20:54:04.78495 [SEVERE] es: _index:global command:index status:400 _id:https://localhost/mgmt/cm/global/tasks/log-pool-mgmt/2bb36182-7020-401c-86a1-168bf5b6cce1 error:{"type":"illegal_argument_exception","reason":"Limit of total fields [5000] in index [global] has been exceeded"} see searchd log for complete error

NOTE: Limit of total fields [5000]

 

Also if you run the following command and only see a result up to 40% then the solution below will probably fix your issue

grep percent /var/log/tokumon/*

@400000006310f8c91883eeac.s:2022-09-01_18:19:52.10333 [INFO] postgres_configurator: sendFind: percentComplete: 0. Progress: [                                                  ]
@400000006310f8c91883eeac.s:2022-09-01_18:20:56.48001 [INFO] postgres_configurator: sendFind: percentComplete: 3. Progress: [=                                                 ]
@400000006310f8c91883eeac.s:2022-09-01_18:21:31.13141 [INFO] postgres_configurator: sendFind: percentComplete: 7. Progress: [===                                               ]
@400000006310f8c91883eeac.s:2022-09-01_18:22:10.25619 [INFO] postgres_configurator: sendFind: percentComplete:10. Progress: [=====                                             ]
@400000006310f8c91883eeac.s:2022-09-01_18:22:33.34480 [INFO] postgres_configurator: sendFind: percentComplete:14. Progress: [=======                                           ]
@400000006310f8c91883eeac.s:2022-09-01_18:22:36.36273 [INFO] postgres_configurator: sendFind: percentComplete:18. Progress: [=========                                         ]
@400000006310fe092f593934.s:2022-09-01_18:25:19.65314 [INFO] postgres_configurator: sendFind: percentComplete:21. Progress: [==========                                        ]
@400000006310fe092f593934.s:2022-09-01_18:25:35.79095 [INFO] postgres_configurator: sendFind: percentComplete:25. Progress: [============                                      ]
@400000006310fe092f593934.s:2022-09-01_18:25:39.21993 [INFO] postgres_configurator: sendFind: percentComplete:29. Progress: [==============                                    ]
@400000006310fe092f593934.s:2022-09-01_18:25:40.50506 [INFO] postgres_configurator: sendFind: percentComplete:32. Progress: [================                                  ]
@400000006310fe092f593934.s:2022-09-01_18:25:43.14887 [INFO] postgres_configurator: sendFind: percentComplete:36. Progress: [==================                                ]
@400000006310fe092f593934.s:2022-09-01_18:25:44.20091 [INFO] postgres_configurator: sendFind: percentComplete:40. Progress: [====================                              ]
@4000000063110a5e23ef1e9c.s:2022-09-01_19:36:20.30337 [INFO] postgres_configurator: sendFind: percentComplete: 0. Progress: [                                                  ]
@4000000063110a5e23ef1e9c.s:2022-09-01_19:38:16.74310 [INFO] postgres_configurator: sendFind: percentComplete: 3. Progress: [=                                                 ]
@4000000063110a5e23ef1e9c.s:2022-09-01_19:38:59.11996 [INFO] postgres_configurator: sendFind: percentComplete: 7. Progress: [===                                               ]
@40000000631110a61bd8884c.s:2022-09-01_19:39:44.35119 [INFO] postgres_configurator: sendFind: percentComplete:10. Progress: [=====                                             ]
@40000000631110a61bd8884c.s:2022-09-01_19:40:12.92306 [INFO] postgres_configurator: sendFind: percentComplete:14. Progress: [=======                                           ]
@40000000631110a61bd8884c.s:2022-09-01_19:40:16.42442 [INFO] postgres_configurator: sendFind: percentComplete:18. Progress: [=========                                         ]
@40000000631110a61bd8884c.s:2022-09-01_19:43:31.32524 [INFO] postgres_configurator: sendFind: percentComplete:21. Progress: [==========                                        ]
@40000000631110a61bd8884c.s:2022-09-01_19:43:48.55782 [INFO] postgres_configurator: sendFind: percentComplete:25. Progress: [============                                      ]
@40000000631110a61bd8884c.s:2022-09-01_19:43:52.53171 [INFO] postgres_configurator: sendFind: percentComplete:29. Progress: [==============                                    ]
@40000000631110a61bd8884c.s:2022-09-01_19:43:54.13572 [INFO] postgres_configurator: sendFind: percentComplete:32. Progress: [================                                  ]
@40000000631110a61bd8884c.s:2022-09-01_19:43:57.11501 [INFO] postgres_configurator: sendFind: percentComplete:36. Progress: [==================                                ]
@40000000631110a61bd8884c.s:2022-09-01_19:43:58.33266 [INFO] postgres_configurator: sendFind: percentComplete:40. Progress: [====================                              ]

SOLUTION

You need to do a slight modification (at least that's what I needed to do) with guidance from support.

mount -o rw,remount /usr

vi /usr/share/rest/tokumon/config/modules/global.js

'use strict';

exports.GLOBAL = {
    indexName: 'global',
    settings: {
        "index" : {
            "mapping" : {
              "total_fields" : {
                "limit" : "5000"
              }
            }
        }
    },
    mappings: {
        "properties": {
            "_value": {
                "type": "object",
                "properties": {
                    "resources": {
                        "enabled": false
                    },
                    "appSvcsDeclaration": {
                        "enabled": false
                    },
                    "declaration": {
                        "enabled": false
                    },
                    "body": {
                        "enabled": false
                    }
                }
            }
        }
    }
};

this is adding the body statement at the end.  Since you can easily make a syntax error, I suggest copying the entire thing and remove and replace but its your call as long as the body statement is in and looks like and ends like above.

mount -o ro,remount /usr

bigstart kill tokumond

tailf /var/log/tokumon/current  | grep percentComplet

current:2022-09-01_20:56:31.67153 [INFO] postgres_configurator: sendFind: percentComplete: 0. Progress: [                                                  ]
current:2022-09-01_20:57:52.16058 [INFO] postgres_configurator: sendFind: percentComplete: 3. Progress: [=                                                 ]
current:2022-09-01_20:58:30.72284 [INFO] postgres_configurator: sendFind: percentComplete: 7. Progress: [===                                               ]
current:2022-09-01_20:59:15.10986 [INFO] postgres_configurator: sendFind: percentComplete:10. Progress: [=====                                             ]
current:2022-09-01_20:59:42.15947 [INFO] postgres_configurator: sendFind: percentComplete:14. Progress: [=======                                           ]
current:2022-09-01_20:59:45.78599 [INFO] postgres_configurator: sendFind: percentComplete:18. Progress: [=========                                         ]
current:2022-09-01_20:59:50.53854 [INFO] postgres_configurator: sendFind: percentComplete:21. Progress: [==========                                        ]
current:2022-09-01_21:00:08.61312 [INFO] postgres_configurator: sendFind: percentComplete:25. Progress: [============                                      ]
current:2022-09-01_21:00:12.70932 [INFO] postgres_configurator: sendFind: percentComplete:29. Progress: [==============                                    ]
current:2022-09-01_21:00:13.98724 [INFO] postgres_configurator: sendFind: percentComplete:32. Progress: [================                                  ]
current:2022-09-01_21:00:17.42414 [INFO] postgres_configurator: sendFind: percentComplete:36. Progress: [==================                                ]
current:2022-09-01_21:00:18.71053 [INFO] postgres_configurator: sendFind: percentComplete:40. Progress: [====================                              ]
current:2022-09-01_21:01:37.20488 [INFO] postgres_configurator: sendFind: percentComplete:43. Progress: [=====================                             ]
current:2022-09-01_21:01:39.13140 [INFO] postgres_configurator: sendFind: percentComplete:47. Progress: [=======================                           ]
current:2022-09-01_21:01:39.85294 [INFO] postgres_configurator: sendFind: percentComplete:51. Progress: [=========================                         ]
current:2022-09-01_21:01:41.70705 [INFO] postgres_configurator: sendFind: percentComplete:54. Progress: [===========================                       ]
current:2022-09-01_21:01:44.29766 [INFO] postgres_configurator: sendFind: percentComplete:58. Progress: [=============================                     ]
current:2022-09-01_21:02:22.88336 [INFO] postgres_configurator: sendFind: percentComplete:62. Progress: [===============================                   ]
current:2022-09-01_21:02:58.75886 [INFO] postgres_configurator: sendFind: percentComplete:65. Progress: [================================                  ]
current:2022-09-01_21:03:14.11242 [INFO] postgres_configurator: sendFind: percentComplete:69. Progress: [==================================                ]
current:2022-09-01_21:03:32.98830 [INFO] postgres_configurator: sendFind: percentComplete:73. Progress: [====================================              ]
current:2022-09-01_21:03:37.45466 [INFO] postgres_configurator: sendFind: percentComplete:76. Progress: [======================================            ]
current:2022-09-01_21:03:39.60386 [INFO] postgres_configurator: sendFind: percentComplete:80. Progress: [========================================          ]
current:2022-09-01_21:03:40.86741 [INFO] postgres_configurator: sendFind: percentComplete:84. Progress: [==========================================        ]
current:2022-09-01_21:03:41.29606 [INFO] postgres_configurator: sendFind: percentComplete:87. Progress: [===========================================       ]
current:2022-09-01_21:03:41.82372 [INFO] postgres_configurator: sendFind: percentComplete:91. Progress: [=============================================     ]
current:2022-09-01_21:03:42.43096 [INFO] postgres_configurator: sendFind: percentComplete:95. Progress: [===============================================   ]
current:2022-09-01_21:03:42.87142 [INFO] postgres_configurator: sendFind: percentComplete:98. Progress: [================================================= ]

Now it gets past 40% and completes (even though it just ends at 98 but it does complete). Now try and log into the GUI and hopefully this helped fix you as it did myself.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

 Share

×
×
  • Create New...