aws

Verifying indices of an Elasticsearch cluster

3 December, 2018 By gerald Leave a Comment

A quick way to verify the indices of an Elasticsearch cluster. In this example a hostname is configured with multiple IP addresses of Elasticsearch nodes

ubuntu@ip-172-16-2-222:~$ for i in $(dig a +short elasticsearch.green.website.com); do
>   echo $i
>   curl -GET "$i:9200/_cat/indices"
>   echo
> done
172.16.1.242
green open site1  Cw71FOo_TIeYCcmaDB4lGQ 5 1 185 0 920.7kb 460.3kb
green open site2 Z-ckPDijQby1z2yD60CLxg 5 1 185 0   833kb 416.5kb

172.16.3.188
green open site1  Cw71FOo_TIeYCcmaDB4lGQ 5 1 185 0 920.7kb 460.3kb
green open site2 Z-ckPDijQby1z2yD60CLxg 5 1 185 0   833kb 416.5kb

ubuntu@ip-172-16-2-222:~$ for i in $(dig a +short elasticsearch.green.website.com); do

> echo $i

> curl -GET "$i:9200/_cat/indices"

> echo

> done

172.16.1.242

green open site1 Cw71FOo_TIeYCcmaDB4lGQ 5 1 185 0 920.7kb 460.3kb

green open site2 Z-ckPDijQby1z2yD60CLxg 5 1 185 0 833kb 416.5kb

172.16.3.188

green open site1 Cw71FOo_TIeYCcmaDB4lGQ 5 1 185 0 920.7kb 460.3kb

green open site2 Z-ckPDijQby1z2yD60CLxg 5 1 185 0 833kb 416.5kb

To query the current configuration of an Elasticsearch node in pretty JSON format

ubuntu@ip-172-16-2-222:~$ curl -GET "172.16.3.188:9200/_nodes/" | python -m json.tool;

1	ubuntu@ip-172-16-2-222:~$ curl -GET "172.16.3.188:9200/_nodes/" \| python -m json.tool;

Case Sensitivity of Fn::GetAtt in AWS CloudFormation

27 November, 2018 By gerald Leave a Comment

While working on CloudFormation template, and storing the output of the endpoint attribute of a memcached backed cache cluster resource, I used the Fn::GetAtt (!GetAtt) function and came across this message

An error occurred (ValidationError) when calling the CreateStack operation: Template error: resource CacheClusterFoo does not support attribute type ConfigurationEndPoint.Address in Fn::GetAtt

1	An error occurred (ValidationError) when calling the CreateStack operation: Template error: resource CacheClusterFoo does not support attribute type ConfigurationEndPoint.Address in Fn::GetAtt

Example

Outputs:
  OutputCacheClusterEndpointFoo:
    Value: !GetAtt [ CacheClusterFoo,ConfigurationEndpoint.Address ]
    Export:
      Name: !Join [ ":", [ !Ref ParamVpcStackName, CacheClusterEndpointFoo ] ]

Outputs:

OutputCacheClusterEndpointFoo:

Value: !GetAtt [ CacheClusterFoo,ConfigurationEndpoint.Address ]

Export:

Name: !Join [ ":", [ !Ref ParamVpcStackName, CacheClusterEndpointFoo ] ]

It took me some time to realise where I had gone wrong! ConsiderConfigurationEndPoint.Address vs ConfigurationEndpoint.Address. p vs. P!

Thanks to Stack Overflow for pointing this out