VxRail 7.0 Useful Log File Information

by

The following log files can be accessed either via console or SSH to VxRail Manager.

Useful VxRail Manager 7.0.010+ Log Files

Monitor VxRail bring-up logs: dayone.log , short.term.log & firstboot.log:

  • dayone.log – detailed information in relation to initial first run configuration. (/var/log/microservice_log/dayone.log)
  • short.term.log – micro services related information. (/var/log/microservice_log/short.term.log)
  • firstboot.log – detailed information in relation to micro services boot up during initial configuration. (/var/log/firstboot.log)

cd /var/log/microservice_log/ (This location is important when looking for logs)

# cat dayone.log
# tail -f dayone.log
# tail -f dayone.log | grep ERROR
# tail -n 100 dayone.log
# more dayone.log

Note: short.term.log is a good starting point for all microservices related information. For specific microservice log detail filter by the microservices name for example:

  • cat short.term.log | grep microservice.do-vxrail
  • cat short.term.log | grep microservice.do-host
  • cat short.term.log | grep microservice.do-cluster
  • cat short.term.log | grep microservice.do-network
  • cat short.term.log | grep microservice.do-vm
  • cat short.term.log | grep microservice.do-ecosystem
  • cat short.term.log | grep microservice.do-eservices
  • cat short.term.log | grep microservice.do-storage


/var/log/vmware/marvin/tomcat/logs/marvin.log – (Expansion activity)
/var/log/vmware/marvin/tomcat/logs/localhost_access_log.txt – (Http Requests predominately vCenter Plugin requests)
/var/log/vmware/loudmouth/loudmouth.log – (Discovery)
/var/log/vmware/marvin/tomcat/logs/DellPTAgentResponse.log – (PTAgent connectivity issues)
/var/log/mystic/connectors-cluster.log  (Cluster related info such as disk replace, health, shutdown,LED)
/var/log/mystic/connectors-market.log – (Market Catalog)
/var/log/mystic/connectors-esrs.log – (ESRS)
/var/log/mystic/connectors-eservice.log – (Support a/c info, composite bundle download, online chat, community)
/var/log/mystic/web.log – (Upgrade info)
/var/log/mystic/lcm-do.log – (‘DO’ related micro services info during LCM)
/var/log/mystic/lcm-web.log  (Upgrade info)
/var/log/mystic/lcm-migration.log – (If OVA deployment part of upgrade sequence)

Generate log bundle: python /mystic/generateLogBundle.py -v
Bundle location: /tmp/mystic/dc/

#Useful Log analysis commands#
# less /var/log/vmware/marvin/tomcat/logs/marvin.log
# cat /var/log/vmware/marvin/tomcat/logs/marvin.log
# tail -f marvin.log
# tail -f marvin.log | grep ERROR
# tail -f marvin.log | grep ERROR –color
# tail -n 100 marvin.log
# more marvin.log
# history
# du -sh /var/log
# /mystic/generateFullLogBundle

/var is running low on space:

Check available space on VxRail manager with command “df -h”. Clear files under /var/log/microservice_log as needed:

df -h
ls -ltr /var/log/microservice_log
cd /var/log/microservice_log
rm short.term.log_bak*.log
rm long.term_bak*.log
rm dayone_bak*.log

Lookup Event Codes:

psql -U postgres vxrail -c "SELECT * FROM serviceability.event_code ;"

psql -U postgres vxrail -c "SELECT * FROM serviceability.event_code ;" | grep MYSTIC010011

JSON:
cat /var/lib/vmware-marvin/config-initial.json | json_pp

Manifest File:
cat /var/lib/vmware-marvin/manifest.xml

Application Properties:
cat /usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/application.properties

DNS
cat /etc/resolv.conf

NTP
cat /etc/ntp.conf

Notes:
– Transfer Log Files via SCP:
scp ./marvin.log.log ringd@10.10.0.10:/users/ringd/logs/

– Find the directory of a specific log file e.g ‘marvin.log’:
find /* -name marvin.log
find /* -name *cluster.log
find / -iname config-initial.json

-Using DU cmd to search for specific log files:

du -a -h / |grep dayone |grep log

du -a /var/log/ | sort -n -r | head -n 5

vCenter Logs
tail -f /var/log/vmware/vpxd/vpxd.log

ESXi
tail -f /var/run/log/platform_svc.log
tail -f /var/log/vmkernel.log
/opt/dell/DellPTAgent/tools/ipmitool_static fru print 17
esxcli software vib list | grep marvin
vmware -vl
esxcfg-vmknic -l

View Mounts: mount | grep -v docker

RASR Completes with error then check fist.log:

cd /vmfs/volumes

find . -name fist.log 

This is David rings blog post, however want to take a copy so i could start to make my own notes on it:

Leave a Reply

Your email address will not be published. Required fields are marked *