8000 CLI: Not an IndexList Object · Issue #703 · elastic/curator · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

CLI: Not an IndexList Object #703

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
sshantveer opened this issue Jul 25, 2016 · 12 comments
Closed

CLI: Not an IndexList Object #703

sshantveer opened this issue Jul 25, 2016 · 12 comments
Labels
cannot_replicate question

Comments

@sshantveer
Copy link
sshantveer commented Jul 25, 2016 •
edited
Loading

Trying to setup curator on my windows machine to create snapshots of elastic indices. I am following the steps mentioned in the latest documentation.

  • Using curator 4.0.3
  • Using 2.3.3 elasticsearch

Using the same configuration mentioned in the documentation but still getting this below error :

2016-07-25 22:37:20,073 ERROR Failed to complete action: snapshot. <class 'TypeError' at 0x000000001DC3C400>: Not an IndexList object. Type: <class 'curator.indexlist.IndexList' at 0x0000000002E609B8>.

Am i missing any thing ? or is this a known issue ?

My action file :

Action yaml file :
actions:
  1:
    action: snapshot
    description: >-
      Snapshot logstash- prefixed indices older than 1 day (based on index
      creation_date) with the default snapshot name pattern of
      'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip
      the repository filesystem access check.  Use the other options to create
      the snapshot.
    options:
      repository: myrepo    
      name: shan
      ignore_unavailable: False
      include_global_state: True
      partial: False
      wait_for_completion: True
      skip_repo_fs_check: False
      timeout_override:
      continue_if_exception: False
      disable_action: False
    filters:    
    - filtertype: age
      source: creation_date
      direction: younger      
      unit: days
      unit_count: 1
      field:
      stats_result:
      epoch:
      exclude:
@untergeek
Copy link
Member

With this quoted text, I can't see if the YAML configuration indents are done properly.

It could be that your description says indices older than one day but your filter block says younger.

@untergeek
Copy link
Member

Here's an example of one of my snapshot configurations:

  8:
    action: snapshot
    description: >-
      Snapshot daily indices older than 1 day (based on index
      creation_date) with the default snapshot name pattern of
      'daily-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip
      the repository filesystem access check.  Use the other options to create
      the snapshot.
    options:
      ignore_empty_list: True
      repository: Untergeek
      # Leaving name blank will result in the default 'curator-%Y%m%d%H%M%S'
      name: 'daily-%Y%m%d%H%M%S'
      ignore_unavailable: False
      include_global_state: True
      partial: False
      wait_for_completion: True
      skip_repo_fs_check: False
      timeout_override: 7200
      continue_if_exception: False
      disable_action: False
    filters:
    - filtertype: pattern
      kind: timestring
      value: '%Y.%m.%d'
      exclude: False
    - filtertype: age
      source: creation_date
      direction: older
      unit: days
      unit_count: 1
      exclude:
    - filtertype: closed

@sshantveer
Copy link
Author
sshantveer commented Jul 25, 2016 •
edited
Loading

Sorry for not being clear in the description. I was doing some changes to verify if I had some issues with filter. Indents were proper.
Below is the log generated when i run it. (Also tried the action you provided)

 2016-07-26 00:50:45,931 INFO      Action #1: snapshot
2016-07-26 00:50:45,932 INFO      Starting new HTTP connection (1): 127.0.0.1
2016-07-26 00:50:45,947 INFO      GET http://127.0.0.1:9200/ [status:200 request:0.015s]
2016-07-26 00:50:45,949 INFO      GET http://127.0.0.1:9200/_all/_settings?expand_wildcards=open%2Cclosed [status:200 request:0.002s]
2016-07-26 00:50:45,954 INFO      GET http://127.0.0.1:9200/_cluster/state/metadata/.marvel-es-1-2016.06.27,.marvel-es-1-2016.06.28,.marvel-es-1-2016.06.29,.marvel-es-1-2016.06.30,.marvel-es-data-1,som-claim-1 [status:200 request:0.005s]
2016-07-26 00:50:45,957 INFO      GET http://127.0.0.1:9200/.marvel-es-1-2016.06.27,.marvel-es-1-2016.06.28,.marvel-es-1-2016.06.29,.marvel-es-1-2016.06.30,.marvel-es-data-1,som-claim-1/_stats/store,docs [status:200 request:0.002s]
2016-07-26 00:50:45,958 ERROR     Failed to complete action: snapshot.  <class 'TypeError' at 0x000000001DE2C400>: Not an IndexList object. Type: <class 'curator.indexlist.IndexList' at 0x0000000002D86808>.

@untergeek
Copy link
Member

Please attach DEBUG level logs for further analysis. I just completed two tests of the exact action I posted from my Windows test machine using v4.0.3: once with DEBUG logging, and once in INFO. It worked both times (and the snapshot was practically instantaneous the second time, since the segments didn't change much). The INFO level output looks like this:

2016-07-25 18:08:17,461 INFO      Action #8: snapshot
2016-07-25 18:08:17,739 INFO      Creating snapshot "daily-20160726000817" from indices: [u'.marvel-es-1-2016.07.20', u'logstash-2016.07.12', u'logstash-2016.07.13', u'.marvel-es-1-2016.07.19', u'logstash-2016.07.15', u'logstash-2016.07.16', u'.marvel-es-1-2016.07.21', u'logstash-2016.07.18', u'logstash-2016.07.19', u'.marvel-es-1-2016.07.23', u'.marvel-es-1-2016.07.24', u'logstash-2016.07.14', u'logstash-2016.07.20', u'topbeat-2016.07.13', u'topbeat-2016.07.12', u'topbeat-2016.07.15', u'topbeat-2016.07.17', u'topbeat-2016.07.16', u'topbeat-2016.07.19', u'topbeat-2016.07.18', u'logstash-2016.07.17', u'logstash-2016.07.25', u'logstash-2016.07.24', u'.marvel-es-1-2016.07.22', u'logstash-2016.07.21', u'.marvel-es-1-2016.07.25', u'logstash-2016.07.23', u'logstash-2016.07.22', u'topbeat-2016.07.24', u'topbeat-2016.07.25', u'topbeat-2016.07.20', u'topbeat-2016.07.21', u'topbeat-2016.07.22', u'topbeat-2016.07.23', u'topbeat-2016.07.14']
2016-07-25 18:08:19,578 INFO      Snapshot daily-20160726000817 successfully completed.
2016-07-25 18:08:19,578 INFO      Action #8: completed
2016-07-25 18:08:19,578 INFO      Job completed.

I note that your logs include the elasticsearch and urllib3 log lines. This should not be happening unless you have set blacklist: [] in your client configuration file (this is a brand new setting in 4.0.3, and it is not widely known yet, so I'd be surprised if you did this). This suggests to me that you may not be running v4.0.3, or that the code between versions is mixed.

Are you running the curator.exe file? Did you install from pip? Did you use the MSI installer? There is a known issue with the MSI installer needing old versions to be uninstalled before new ones are installed, otherwise there will be 2 versions installed at once.

@untergeek
Copy link
Member

@vidhyarti Please respond with the files and answers requested. I am unable to duplicate this behavior on Windows with the Elastic-provided binary.

@sshantveer
Copy link
Author
sshantveer commented Jul 26, 2016 •
edited
Loading

@untergeek Thanks for reply.

  • Yes, I have set blacklist to empty array. (Was trying) I am using v4.0.3
  • I tried to install using MSI installer. Uninstalled it and installed it using PIP.

Please find the debug logs for the action file.

actions:
  1:
    action: snapshot
    description: >-
      Snapshot all indices older than 1 day (based on index
      creation_date) with the default snapshot name pattern of
      'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip
      the repository filesystem access check.  Use the other options to create
      the snapshot.
    options:
      repository: my_backup    
      name: 
      ignore_unavailable: False
      include_global_state: True
      partial: False
      wait_for_completion: True
      skip_repo_fs_check: False
      timeout_override:
      continue_if_exception: False
      disable_action: False
    filters:
    - filtertype:
      state:
      exclude:

Logs

2016-07-26 18:03:33,977 DEBUG                curator.cli                    cli:165  default_timeout = 30
2016-07-26 18:03:33,981 DEBUG                curator.cli                    cli:170  Full list of actions: {1: {'options': {'partial': False, 'ignore_unavailable': False, 'disable_action': False, 'name': None, 'repository': 'my_backup', 'continue_if_exception': False, 'skip_repo_fs_check': False, 'timeout_override': None, 'wait_for_completion': True, 'include_global_state': True}, 'action': 'snapshot', 'description': "Snapshot all indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'state': None, 'filtertype': None, 'exclude': None}]}}
2016-07-26 18:03:33,981 INFO                 curator.cli                    cli:177  Action #1: snapshot
2016-07-26 18:03:33,981 DEBUG                curator.cli                    cli:190  continue_if_exception = False
2016-07-26 18:03:33,981 DEBUG                curator.cli                    cli:191  timeout_override = None
2016-07-26 18:03:33,981 DEBUG              curator.utils             get_client:503  kwargs = {'use_ssl': False, 'aws_region': None, 'http_auth': None, 'timeout': 30, 'master_only': False, 'certificate': None, 'aws_secret_key': None, 'aws_key': None, 'hosts': ['127.0.0.1'], 'client_cert': None, 'port': 9200, 'url_prefix': '', 'client_key': None, 'ssl_no_validate': False}
2016-07-26 18:03:33,981 DEBUG              curator.utils             get_client:548  Not using "requests_aws4auth" python module to connect.
2016-07-26 18:03:33,998 DEBUG              curator.utils          check_version:412  Detected Elasticsearch version 2.3.3
2016-07-26 18:03:33,998 DEBUG                curator.cli                    cli:216  client is <class 'elasticsearch.client.Elasticsearch' at 0x0000000002E382F8>
2016-07-26 18:03:33,998 DEBUG                curator.cli                    cli:222  TRY: actions: {'options': {'partial': False, 'ignore_unavailable': False, 'name': None, 'repository': 'my_backup', 'skip_repo_fs_check': False, 'wait_for_completion': True, 'include_global_state': True}, 'action': 'snapshot', 'description': "Snapshot all indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'state': None, 'filtertype': None, 'exclude': None}]} kwargs: {'master_timeout': 30, 'timeout': 30, 'dry_run': False}
2016-07-26 18:03:33,998 DEBUG                curator.cli         process_action:46   Configuration dictionary: {'options': {'partial': False, 'ignore_unavailable': False, 'name': None, 'repository': 'my_backup', 'skip_repo_fs_check': False, 'wait_for_completion': True, 'include_global_state': True}, 'action': 'snapshot', 'description': "Snapshot all indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'state': None, 'filtertype': None, 'exclude': None}]}
2016-07-26 18:03:33,998 DEBUG                curator.cli         process_action:47   kwargs: {'master_timeout': 30, 'dry_run': False, 'timeout': 30}
2016-07-26 18:03:33,998 DEBUG                curator.cli         process_action:50   opts: {'partial': False, 'ignore_unavailable': False, 'name': None, 'repository': 'my_backup', 'skip_repo_fs_check': False, 'wait_for_completion': True, 'include_global_state': True}
2016-07-26 18:03:33,998 DEBUG                curator.cli         process_action:68   MYKWARGS = {'skip_repo_fs_check': False, 'partial': False, 'ignore_unavailable': False, 'wait_for_completion': True, 'name': 'curator-%Y%m%d%H%M%S', 'include_global_state': True, 'repository': None}
2016-07-26 18:03:33,998 DEBUG                curator.cli         process_action:72   Action kwargs: {'skip_repo_fs_check': False, 'partial': False, 'ignore_unavailable': False, 'wait_for_completion': True, 'name': 'curator-%Y%m%d%H%M%S', 'include_global_state': True, 'repository': 'my_backup'}
2016-07-26 18:03:33,998 DEBUG              curator.utils            verify_args:1018 Arguments for action "snapshot": {'skip_repo_fs_check': False, 'partial': False, 'ignore_unavailable': False, 'wait_for_completion': True, 'name': 'curator-%Y%m%d%H%M%S', 'include_global_state': True, 'repository': 'my_backup'}
2016-07-26 18:03:33,998 DEBUG              curator.utils           matches_keys:1022 options.keys = dict_keys(['skip_repo_fs_check', 'partial', 'ignore_unavailable', 'wait_for_completion', 'name', 'include_global_state', 'repository']) mydict.keys = dict_keys(['skip_repo_fs_check', 'partial', 'ignore_unavailable', 'wait_for_completion', 'name', 'include_global_state', 'repository'])
2016-07-26 18:03:33,998 DEBUG                curator.cli         process_action:102  Running "SNAPSHOT"
2016-07-26 18:03:33,998 DEBUG          curator.indexlist          __get_indices:64   Getting all indices
2016-07-26 18:03:34,002 DEBUG              curator.utils            get_indices:369  All indices: ['.marvel-es-1-2016.06.28', 'som-claim-1', '.marvel-es-1-2016.06.30', '.marvel-es-1-2016.06.29', '.marvel-es-1-2016.06.27', '.marvel-es-data-1']
2016-07-26 18:03:34,002 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 18:03:34,002 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:03:34,002 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:03:34,002 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:03:34,002 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:03:34,002 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:03:34,002 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:03:34,002 DEBUG          curator.indexlist          _get_metadata:141  Getting index metadata
2016-07-26 18:03:34,002 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 18:03:34,022 DEBUG          curator.indexlist       _get_index_stats:109  Getting index stats
2016-07-26 18:03:34,022 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 18:03:34,022 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 18:03:34,022 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 18:03:34,098 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.06.28  Size: 8.7MB  Docs: 28333
2016-07-26 18:03:34,098 DEBUG          curator.indexlist     iterate_over_stats:118  Index: som-claim-1  Size: 31.7MB  Docs: 35882
2016-07-26 18:03:34,098 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.06.30  Size: 26.1MB  Docs: 77987
2016-07-26 18:03:34,098 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.06.29  Size: 27.9MB  Docs: 92236
2016-07-26 18:03:34,098 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.06.27  Size: 7.0MB  Docs: 20786
2016-07-26 18:03:34,098 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-data-1  Size: 33.6KB  Docs: 10
2016-07-26 18:03:34,098 DEBUG          curator.indexlist        iterate_filters:678  Iterating over a list of filters
2016-07-26 18:03:34,098 DEBUG          curator.indexlist        iterate_filters:684  All filters: [{'state': None, 'filtertype': None, 'exclude': None}]
2016-07-26 18:03:34,098 DEBUG          curator.indexlist        iterate_filters:686  Top of the loop: ['.marvel-es-1-2016.06.28', 'som-claim-1', '.marvel-es-1-2016.06.30', '.marvel-es-1-2016.06.29', '.marvel-es-1-2016.06.27', '.marvel-es-data-1']
2016-07-26 18:03:34,099 DEBUG              curator.utils        iterate_filters:687  Un-parsed filter args: {'state': None, 'filtertype': None, 'exclude': None}
2016-07-26 18:03:34,099 ERROR                curator.cli                    cli:242  Failed to complete action: snapshot.  <class 'ValueError' at 0x000000001E18ECF0>: Invalid value for "filtertype": None

@untergeek
Copy link
Member

I just ran your config (against my repository):

» curator --config ~/.curator/test.yml test.yml
2016-07-26 11:02:00,167 DEBUG                curator.cli                    cli:165  default_timeout = 30
2016-07-26 11:02:00,173 DEBUG                curator.cli                    cli:170  Full list of actions: {1: {'action': 'snapshot', 'description': "Snapshot logstash- prefixed indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}], 'options': {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'continue_if_exception': False, 'skip_repo_fs_check': False, 'timeout_override': None, 'disable_action': False, 'include_global_state': True, 'wait_for_completion': True}}}
2016-07-26 11:02:00,173 INFO                 curator.cli                    cli:177  Action #1: snapshot
2016-07-26 11:02:00,173 DEBUG                curator.cli                    cli:190  continue_if_exception = False
2016-07-26 11:02:00,173 DEBUG                curator.cli                    cli:191  timeout_override = None
2016-07-26 11:02:00,173 DEBUG              curator.utils             get_client:503  kwargs = {'aws_secret_key': None, 'url_prefix': '', 'http_auth': None, 'certificate': None, 'aws_key': None, 'aws_region': None, 'client_cert': None, 'hosts': ['172.19.73.13'], 'timeout': 30, 'use_ssl': False, 'master_only': False, 'port': 9200, 'ssl_no_validate': False, 'client_key': None}
2016-07-26 11:02:00,173 DEBUG              curator.utils             get_client:548  Not using "requests_aws4auth" python module to connect.
2016-07-26 11:02:00,177 DEBUG              curator.utils          check_version:412  Detected Elasticsearch version 2.3.3
2016-07-26 11:02:00,177 DEBUG                curator.cli                    cli:216  client is <class 'elasticsearch.client.Elasticsearch'>
2016-07-26 11:02:00,177 DEBUG                curator.cli                    cli:222  TRY: actions: {'action': 'snapshot', 'description': "Snapshot logstash- prefixed indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}], 'options': {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}} kwargs: {'master_timeout': 30, 'timeout': 30, 'dry_run': False}
2016-07-26 11:02:00,177 DEBUG                curator.cli         process_action:46   Configuration dictionary: {'action': 'snapshot', 'description': "Snapshot logstash- prefixed indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}], 'options': {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}}
2016-07-26 11:02:00,177 DEBUG                curator.cli         process_action:47   kwargs: {'master_timeout': 30, 'dry_run': False, 'timeout': 30}
2016-07-26 11:02:00,177 DEBUG                curator.cli         process_action:50   opts: {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}
2016-07-26 11:02:00,178 DEBUG                curator.cli         process_action:68   MYKWARGS = {'ignore_unavailable': False, 'partial': False, 'name': 'curator-%Y%m%d%H%M%S', 'repository': None, 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}
2016-07-26 11:02:00,178 DEBUG                curator.cli         process_action:72   Action kwargs: {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}
2016-07-26 11:02:00,178 DEBUG              curator.utils            verify_args:1018 Arguments for action "snapshot": {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}
2016-07-26 11:02:00,178 DEBUG              curator.utils           matches_keys:1022 options.keys = ['ignore_unavailable', 'partial', 'name', 'repository', 'skip_repo_fs_check', 'include_global_state', 'wait_for_completion'] mydict.keys = ['ignore_unavailable', 'partial', 'name', 'repository', 'skip_repo_fs_check', 'include_global_state', 'wait_for_completion']
2016-07-26 11:02:00,178 DEBUG                curator.cli         process_action:102  Running "SNAPSHOT"
2016-07-26 11:02:00,178 DEBUG          curator.indexlist          __get_indices:64   Getting all indices
2016-07-26 11:02:00,187 DEBUG              curator.utils            get_indices:369  All indices: [u'.marvel-es-1-2016.07.20', u'logstash-2016.07.12', u'logstash-2016.07.13', u'logstash-2016.07.14', u'logstash-2016.07.15', u'logstash-2016.07.16', u'.marvel-es-1-2016.07.21', u'logstash-2016.07.18', u'logstash-2016.07.19', u'.marvel-es-1-2016.07.23', u'.kibana', u'.marvel-es-1-2016.07.24', u'logstash-2016.07.20', u'topbeat-2016.07.13', u'topbeat-2016.07.12', u'topbeat-2016.07.15', u'.marvel-es-1-2016.07.26', u'topbeat-2016.07.17', u'topbeat-2016.07.16', u'topbeat-2016.07.19', u'topbeat-2016.07.18', u'logstash-2016.07.17', u'squid-2016.07', u'squid-2016.06', u'squid-2016.05', u'logstash-2016.07.25', u'logstash-2016.07.24', u'.marvel-es-1-2016.07.22', u'logstash-2016.07.26', u'logstash-2016.07.21', u'.marvel-es-1-2016.07.25', u'logstash-2016.07.23', u'logstash-2016.07.22', u'nxfilter-2016.06', u'nxfilter-2016.07', u'topbeat-2016.07.24', u'topbeat-2016.07.25', u'topbeat-2016.07.26', u'topbeat-2016.07.20', u'topbeat-2016.07.21', u'topbeat-2016.07.22', u'topbeat-2016.07.23', u'.marvel-es-data-1', u'topbeat-2016.07.14', u'packetbeat-2016.06', u'packetbeat-2016.07', u'packetbeat-2016.04', u'packetbeat-2016.05', u'packetbeat-2016.03', u'packetbeat-2016.01']
2016-07-26 11:02:00,187 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 11:02:00,187 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,187 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,187 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,187 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,187 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,187 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,187 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,187 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,188 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,189 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:02:00,190 DEBUG          curator.indexlist          _get_metadata:141  Getting index metadata
2016-07-26 11:02:00,190 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 11:02:00,746 DEBUG          curator.indexlist       _get_index_stats:109  Getting index stats
2016-07-26 11:02:00,746 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 11:02:00,746 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 11:02:00,746 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 11:02:00,760 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.20  Size: 625.4MB  Docs: 1073808
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.13  Size: 782.0MB  Docs: 5868498
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.14  Size: 781.4MB  Docs: 5867804
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.15  Size: 780.1MB  Docs: 5866694
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.16  Size: 772.7MB  Docs: 5865100
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.17  Size: 766.9MB  Docs: 5864406
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.18  Size: 770.4MB  Docs: 5865226
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.19  Size: 769.6MB  Docs: 5865392
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.21  Size: 638.2MB  Docs: 1092220
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.23  Size: 619.1MB  Docs: 1061902
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .kibana  Size: 249.8KB  Docs: 114
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.24  Size: 615.0MB  Docs: 1071450
2016-07-26 11:02:00,761 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.25  Size: 616.1MB  Docs: 1072454
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.26  Size: 450.1MB  Docs: 769836
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.13  Size: 460.3MB  Docs: 1457302
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.15  Size: 452.5MB  Docs: 1434886
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.14  Size: 449.5MB  Docs: 1435384
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.17  Size: 452.1MB  Docs: 1435102
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.16  Size: 452.5MB  Docs: 1435326
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.19  Size: 464.6MB  Docs: 1464818
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.18  Size: 458.3MB  Docs: 1448342
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: squid-2016.07  Size: 210.1MB  Docs: 674788
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: squid-2016.06  Size: 1007.8MB  Docs: 4045432
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: squid-2016.05  Size: 153.7MB  Docs: 845050
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.25  Size: 788.8MB  Docs: 5854906
2016-07-26 11:02:00,762 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.24  Size: 791.2MB  Docs: 5865156
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.22  Size: 639.7MB  Docs: 1092084
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.26  Size: 557.8MB  Docs: 4170652
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.21  Size: 781.9MB  Docs: 5865306
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.20  Size: 771.5MB  Docs: 5866468
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.23  Size: 781.6MB  Docs: 5864324
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.22  Size: 783.9MB  Docs: 5866724
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: nxfilter-2016.06  Size: 80.7MB  Docs: 725678
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: nxfilter-2016.07  Size: 156.3MB  Docs: 721248
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.24  Size: 644.6MB  Docs: 1557788
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.25  Size: 632.5MB  Docs: 1558610
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.26  Size: 438.6MB  Docs: 1109014
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.20  Size: 631.8MB  Docs: 1569118
2016-07-26 11:02:00,763 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.21  Size: 656.9MB  Docs: 1588514
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.22  Size: 649.5MB  Docs: 1567138
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.23  Size: 655.2MB  Docs: 1580592
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-data-1  Size: 4.5MB  Docs: 30
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.06  Size: 516.1MB  Docs: 271240
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.07  Size: 278.4MB  Docs: 166288
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.04  Size: 290.9MB  Docs: 275570
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.05  Size: 422.7MB  Docs: 270432
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.03  Size: 424.9MB  Docs: 336976
2016-07-26 11:02:00,764 DEBUG          curator.indexlist     iterate_
8000
over_stats:118  Index: packetbeat-2016.01  Size: 1.2GB  Docs: 193962
2016-07-26 11:02:00,764 DEBUG          curator.indexlist        iterate_filters:678  Iterating over a list of filters
2016-07-26 11:02:00,764 DEBUG          curator.indexlist        iterate_filters:684  All filters: [{'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}]
2016-07-26 11:02:00,764 DEBUG          curator.indexlist        iterate_filters:686  Top of the loop: [u'.marvel-es-1-2016.07.20', u'logstash-2016.07.12', u'logstash-2016.07.13', u'logstash-2016.07.14', u'logstash-2016.07.15', u'logstash-2016.07.16', u'.marvel-es-1-2016.07.21', u'logstash-2016.07.18', u'logstash-2016.07.19', u'.marvel-es-1-2016.07.23', u'.kibana', u'.marvel-es-1-2016.07.24', u'logstash-2016.07.20', u'topbeat-2016.07.13', u'topbeat-2016.07.12', u'topbeat-2016.07.15', u'.marvel-es-1-2016.07.26', u'topbeat-2016.07.17', u'topbeat-2016.07.16', u'topbeat-2016.07.19', u'topbeat-2016.07.18', u'logstash-2016.07.17', u'squid-2016.07', u'squid-2016.06', u'squid-2016.05', u'logstash-2016.07.25', u'logstash-2016.07.24', u'.marvel-es-1-2016.07.22', u'logstash-2016.07.26', u'logstash-2016.07.21', u'.marvel-es-1-2016.07.25', u'logstash-2016.07.23', u'logstash-2016.07.22', u'nxfilter-2016.06', u'nxfilter-2016.07', u'topbeat-2016.07.24', u'topbeat-2016.07.25', u'topbeat-2016.07.26', u'topbeat-2016.07.20', u'topbeat-2016.07.21', u'topbeat-2016.07.22', u'topbeat-2016.07.23', u'.marvel-es-data-1', u'topbeat-2016.07.14', u'packetbeat-2016.06', u'packetbeat-2016.07', u'packetbeat-2016.04', u'packetbeat-2016.05', u'packetbeat-2016.03', u'packetbeat-2016.01']
2016-07-26 11:02:00,765 DEBUG              curator.utils        iterate_filters:687  Un-parsed filter args: {'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}
2016-07-26 11:02:00,765 DEBUG              curator.utils        iterate_filters:713  Filter args: {'direction': 'younger', 'stats_result': 'min_value', 'field': None, 'source': 'creation_date', 'epoch': None, 'timestring': None, 'exclude': False, 'unit_count': 1, 'unit': 'days'}
2016-07-26 11:02:00,765 DEBUG              curator.utils        iterate_filters:714  Pre-instance: [u'.marvel-es-1-2016.07.20', u'logstash-2016.07.12', u'logstash-2016.07.13', u'logstash-2016.07.14', u'logstash-2016.07.15', u'logstash-2016.07.16', u'.marvel-es-1-2016.07.21', u'logstash-2016.07.18', u'logstash-2016.07.19', u'.marvel-es-1-2016.07.23', u'.kibana', u'.marvel-es-1-2016.07.24', u'logstash-2016.07.20', u'topbeat-2016.07.13', u'topbeat-2016.07.12', u'topbeat-2016.07.15', u'.marvel-es-1-2016.07.26', u'topbeat-2016.07.17', u'topbeat-2016.07.16', u'topbeat-2016.07.19', u'topbeat-2016.07.18', u'logstash-2016.07.17', u'squid-2016.07', u'squid-2016.06', u'squid-2016.05', u'logstash-2016.07.25', u'logstash-2016.07.24', u'.marvel-es-1-2016.07.22', u'logstash-2016.07.26', u'logstash-2016.07.21', u'.marvel-es-1-2016.07.25', u'logstash-2016.07.23', u'logstash-2016.07.22', u'nxfilter-2016.06', u'nxfilter-2016.07', u'topbeat-2016.07.24', u'topbeat-2016.07.25', u'topbeat-2016.07.26', u'topbeat-2016.07.20', u'topbeat-2016.07.21', u'topbeat-2016.07.22', u'topbeat-2016.07.23', u'.marvel-es-data-1', u'topbeat-2016.07.14', u'packetbeat-2016.06', u'packetbeat-2016.07', u'packetbeat-2016.04', u'packetbeat-2016.05', u'packetbeat-2016.03', u'packetbeat-2016.01']
2016-07-26 11:02:00,765 DEBUG          curator.indexlist          filter_by_age:338  Filtering indices by age
2016-07-26 11:02:00,765 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 11:02:00,765 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.20 is not actionable, removing from list.
2016-07-26 11:02:00,765 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.20" age (1468972802), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,765 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.12 is not actionable, removing from list.
2016-07-26 11:02:00,765 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.12" age (1468281605), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,765 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.13 is not actionable, removing from list.
2016-07-26 11:02:00,765 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.13" age (1468368005), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,765 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.14 is not actionable, removing from list.
2016-07-26 11:02:00,766 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.14" age (1468454405), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,766 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.15 is not actionable, removing from list.
2016-07-26 11:02:00,766 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.15" age (1468540805), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,766 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.16 is not actionable, removing from list.
2016-07-26 11:02:00,766 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.16" age (1468627205), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,766 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.21 is not actionable, removing from list.
2016-07-26 11:02:00,766 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.21" age (1469059201), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,766 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.18 is not actionable, removing from list.
2016-07-26 11:02:00,766 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.18" age (1468800003), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,766 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.19 is not actionable, removing from list.
2016-07-26 11:02:00,766 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.19" age (1468886403), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,766 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.23 is not actionable, removing from list.
2016-07-26 11:02:00,766 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.23" age (1469232000), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,766 DEBUG          curator.indexlist       __not_actionable:38   Index .kibana is not actionable, removing from list.
2016-07-26 11:02:00,766 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".kibana" age (1424476118), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,767 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.24 is not actionable, removing from list.
2016-07-26 11:02:00,767 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.24" age (1469318400), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,767 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.20 is not actionable, removing from list.
2016-07-26 11:02:00,767 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.20" age (1468972803), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,767 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.13 is not actionable, removing from list.
2016-07-26 11:02:00,767 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.13" age (1468368007), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,767 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.12 is not actionable, removing from list.
2016-07-26 11:02:00,767 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.12" age (1468281607), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,767 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.15 is not actionable, removing from list.
2016-07-26 11:02:00,767 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.15" age (1468540808), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,767 DEBUG          curator.indexlist           __actionable:34   Index .marvel-es-1-2016.07.26 is actionable and remains in the list.
2016-07-26 11:02:00,767 DEBUG          curator.indexlist            __excludify:57   Remains in actionable list: Index ".marvel-es-1-2016.07.26" age (1469491202), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,767 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.17 is not actionable, removing from list.
2016-07-26 11:02:00,768 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.17" age (1468713608), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,768 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.16 is not actionable, removing from list.
2016-07-26 11:02:00,768 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.16" age (1468627208), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,768 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.19 is not actionable, removing from list.
2016-07-26 11:02:00,768 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.19" age (1468886408), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,768 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.18 is not actionable, removing from list.
2016-07-26 11:02:00,768 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.18" age (1468800008), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,768 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.17 is not actionable, removing from list.
2016-07-26 11:02:00,768 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.17" age (1468713603), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,768 DEBUG          curator.indexlist       __not_actionable:38   Index squid-2016.07 is not actionable, removing from list.
2016-07-26 11:02:00,768 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "squid-2016.07" age (1467331205), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,768 DEBUG          curator.indexlist       __not_actionable:38   Index squid-2016.06 is not actionable, removing from list.
2016-07-26 11:02:00,768 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "squid-2016.06" age (1464739202), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,768 DEBUG          curator.indexlist       __not_actionable:38   Index squid-2016.05 is not actionable, removing from list.
2016-07-26 11:02:00,768 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "squid-2016.05" age (1463693537), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,769 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.25 is not actionable, removing from list.
2016-07-26 11:02:00,769 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.25" age (1469404805), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,769 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.24 is not actionable, removing from list.
2016-07-26 11:02:00,769 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.24" age (1469318405), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,769 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.22 is not actionable, removing from list.
2016-07-26 11:02:00,769 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.22" age (1469145602), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,769 DEBUG          curator.indexlist           __actionable:34   Index logstash-2016.07.26 is actionable and remains in the list.
2016-07-26 11:02:00,769 DEBUG          curator.indexlist            __excludify:57   Remains in actionable list: Index "logstash-2016.07.26" age (1469491205), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,769 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.21 is not actionable, removing from list.
2016-07-26 11:02:00,769 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.21" age (1469059205), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,769 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.25 is not actionable, removing from list.
2016-07-26 11:02:00,769 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.25" age (1469404800), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,769 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.23 is not actionable, removing from list.
2016-07-26 11:02:00,769 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.23" age (1469232005), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,770 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.22 is not actionable, removing from list.
2016-07-26 11:02:00,770 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.22" age (1469145605), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,770 DEBUG          curator.indexlist       __not_actionable:38   Index nxfilter-2016.06 is not actionable, removing from list.
2016-07-26 11:02:00,770 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "nxfilter-2016.06" age (1464899541), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,770 DEBUG          curator.indexlist       __not_actionable:38   Index nxfilter-2016.07 is not actionable, removing from list.
2016-07-26 11:02:00,770 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "nxfilter-2016.07" age (1467331203), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,770 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.24 is not actionable, removing from list.
2016-07-26 11:02:00,770 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.24" age (1469318408), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,770 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.25 is not actionable, removing from list.
2016-07-26 11:02:00,770 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.25" age (1469404807), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,770 DEBUG          curator.indexlist           __actionable:34   Index topbeat-2016.07.26 is actionable and remains in the list.
2016-07-26 11:02:00,770 DEBUG          curator.indexlist            __excludify:57   Remains in actionable list: Index "topbeat-2016.07.26" age (1469491208), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,770 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.20 is not actionable, removing from list.
2016-07-26 11:02:00,770 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.20" age (1468972807), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,771 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.21 is not actionable, removing from list.
2016-07-26 11:02:00,771 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.21" age (1469059206), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,771 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.22 is not actionable, removing from list.
2016-07-26 11:02:00,771 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.22" age (1469145608), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,771 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.23 is not actionable, removing from list.
2016-07-26 11:02:00,771 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.23" age (1469232007), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,771 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-data-1 is not actionable, removing from list.
2016-07-26 11:02:00,771 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-data-1" age (1464979408), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,771 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.14 is not actionable, removing from list.
2016-07-26 11:02:00,771 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.14" age (1468454407), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,771 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.06 is not actionable, removing from list.
2016-07-26 11:02:00,771 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.06" age (1464739226), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,771 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.07 is not actionable, removing from list.
2016-07-26 11:02:00,771 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.07" age (1467331208), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,772 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.04 is not actionable, removing from list.
2016-07-26 11:02:00,772 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.04" age (1459468824), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,772 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.05 is not actionable, removing from list.
2016-07-26 11:02:00,772 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.05" age (1462060888), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,772 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.03 is not actionable, removing from list.
2016-07-26 11:02:00,772 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.03" age (1456790407), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,772 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.01 is not actionable, removing from list.
2016-07-26 11:02:00,772 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.01" age (1452209738), direction: "younger", point of reference, (1469466120)
2016-07-26 11:02:00,772 DEBUG              curator.utils        iterate_filters:716  Post-instance: [u'.marvel-es-1-2016.07.26', u'logstash-2016.07.26', u'topbeat-2016.07.26']
2016-07-26 11:02:00,774 DEBUG              curator.utils      repository_exists:911  Repository Untergeek exists.
2016-07-26 11:02:00,774 DEBUG              curator.utils     parse_date_pattern:995  Partially rendered name: s
2016-07-26 11:02:00,774 DEBUG              curator.utils     parse_date_pattern:995  Partially rendered name: sh
2016-07-26 11:02:00,774 DEBUG              curator.utils     parse_date_pattern:995  Partially rendered name: sha
2016-07-26 11:02:00,774 DEBUG              curator.utils     parse_date_pattern:995  Partially rendered name: shan
2016-07-26 11:02:00,774 DEBUG              curator.utils     parse_date_pattern:997  Fully rendered name: shan
2016-07-26 11:02:00,774 DEBUG                curator.cli         process_action:110  Doing the action here.
2016-07-26 11:02:00,774 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 11:02:00,846 DEBUG              curator.utils           test_repo_fs:927  All nodes can write to the repository
2016-07-26 11:02:00,846 DEBUG              curator.utils           test_repo_fs:929  Nodes with verified repository access: {u'HD9y66SKRleRoj82_eK2bA': {u'name': u'MacBuntu1'}, u'7DVvG6djQFuYxxK-4sIdHQ': {u'name': u'Elasticbox'}, u'-LDbj7sGRmC7zdirMA82rA': {u'name': u'MacBuntu2'}, u'TKH6UI_VQk6GnMk5DE3mbQ': {u'name': u'esmaster'}}
2016-07-26 11:02:00,848 INFO      curator.actions.snapshot              do_action:741  Creating snapshot "shan" from indices: [u'.marvel-es-1-2016.07.26', u'logstash-2016.07.26', u'topbeat-2016.07.26']

This was from Linux. I will test against the MSI package when my windows box comes up.

@sshantveer
Copy link
Author

I updated the comment with action file and debug logs. Not sure if I am doing anything wrong.
I will also uninstall Curator and do a clean install again using PIP and check.
Thanks for looking into this.

@untergeek
Copy link
Member

This is the output from the Windows MSI package:

2016-07-26 11:22:08,719 DEBUG                curator.cli                    cli:165  default_timeout = 30
2016-07-26 11:22:08,726 DEBUG                curator.cli                    cli:170  Full list of actions: {1: {'action': 'snapshot', 'description': "Snapshot logstash- prefixed indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}], 'options': {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'continue_if_exception': False, 'skip_repo_fs_check': False, 'timeout_override': 7200, 'disable_action': False, 'include_global_state': True, 'wait_for_completion': True}}}
2016-07-26 11:22:08,726 INFO                 curator.cli                    cli:177  Action #1: snapshot
2016-07-26 11:22:08,726 DEBUG                curator.cli                    cli:190  continue_if_exception = False
2016-07-26 11:22:08,726 DEBUG                curator.cli                    cli:191  timeout_override = 7200
2016-07-26 11:22:08,726 DEBUG              curator.utils             get_client:503  kwargs = {'aws_secret_key': None, 'url_prefix': '', 'http_auth': None, 'certificate': None, 'aws_key': None, 'aws_region': None, 'client_cert': None, 'hosts': ['172.19.73.13'], 'timeout': 7200, 'use_ssl': False, 'master_only': False, 'port': 9200, 'ssl_no_validate': False, 'client_key': None}
2016-07-26 11:22:08,726 DEBUG              curator.utils             get_client:548  Not using "requests_aws4auth" python module to connect.
2016-07-26 11:22:08,734 DEBUG              curator.utils          check_version:412  Detected Elasticsearch version 2.3.3
2016-07-26 11:22:08,736 DEBUG                curator.cli                    cli:216  client is <class 'elasticsearch.client.Elasticsearch'>
2016-07-26 11:22:08,736 DEBUG                curator.cli                    cli:222  TRY: actions: {'action': 'snapshot', 'description': "Snapshot logstash- prefixed indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}], 'options': {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}} kwargs: {'master_timeout': 300, 'timeout': 7200, 'dry_run': False}
2016-07-26 11:22:08,736 DEBUG                curator.cli         process_action:46   Configuration dictionary: {'action': 'snapshot', 'description': "Snapshot logstash- prefixed indices older than 1 day (based on index creation_date) with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'filters': [{'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}], 'options': {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}}
2016-07-26 11:22:08,736 DEBUG                curator.cli         process_action:47   kwargs: {'master_timeout': 300, 'dry_run': False, 'timeout': 7200}
2016-07-26 11:22:08,736 DEBUG                curator.cli         process_action:50   opts: {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}
2016-07-26 11:22:08,736 DEBUG                curator.cli         process_action:68   MYKWARGS = {'ignore_unavailable': False, 'partial': False, 'name': 'curator-%Y%m%d%H%M%S', 'repository': None, 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}
2016-07-26 11:22:08,736 DEBUG                curator.cli         process_action:72   Action kwargs: {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}
2016-07-26 11:22:08,736 DEBUG              curator.utils            verify_args:1018 Arguments for action "snapshot": {'ignore_unavailable': False, 'partial': False, 'name': 'shan', 'repository': 'Untergeek', 'skip_repo_fs_check': False, 'include_global_state': True, 'wait_for_completion': True}
2016-07-26 11:22:08,736 DEBUG              curator.utils           matches_keys:1022 options.keys = ['ignore_unavailable', 'partial', 'name', 'repository', 'skip_repo_fs_check', 'include_global_state', 'wait_for_completion'] mydict.keys = ['ignore_unavailable', 'partial', 'name', 'repository', 'skip_repo_fs_check', 'include_global_state', 'wait_for_completion']
2016-07-26 11:22:08,736 DEBUG                curator.cli         process_action:102  Running "SNAPSHOT"
2016-07-26 11:22:08,736 DEBUG          curator.indexlist          __get_indices:64   Getting all indices
2016-07-26 11:22:08,749 DEBUG              curator.utils            get_indices:369  All indices: [u'.marvel-es-1-2016.07.20', u'logstash-2016.07.12', u'logstash-2016.07.13', u'logstash-2016.07.14', u'logstash-2016.07.15', u'logstash-2016.07.16', u'.marvel-es-1-2016.07.21', u'logstash-2016.07.18', u'logstash-2016.07.19', u'.marvel-es-1-2016.07.23', u'.kibana', u'.marvel-es-1-2016.07.24', u'logstash-2016.07.20', u'topbeat-2016.07.13', u'topbeat-2016.07.12', u'topbeat-2016.07.15', u'.marvel-es-1-2016.07.26', u'topbeat-2016.07.17', u'topbeat-2016.07.16', u'topbeat-2016.07.19', u'topbeat-2016.07.18', u'logstash-2016.07.17', u'squid-2016.07', u'squid-2016.06', u'squid-2016.05', u'logstash-2016.07.25', u'logstash-2016.07.24', u'.marvel-es-1-2016.07.22', u'logstash-2016.07.26', u'logstash-2016.07.21', u'.marvel-es-1-2016.07.25', u'logstash-2016.07.23', u'logstash-2016.07.22', u'nxfilter-2016.06', u'nxfilter-2016.07', u'topbeat-2016.07.24', u'topbeat-2016.07.25', u'topbeat-2016.07.26', u'topbeat-2016.07.20', u'topbeat-2016.07.21', u'topbeat-2016.07.22', u'topbeat-2016.07.23', u'.marvel-es-data-1', u'topbeat-2016.07.14', u'packetbeat-2016.06', u'packetbeat-2016.07', u'packetbeat-2016.04', u'packetbeat-2016.05', u'packetbeat-2016.03', u'packetbeat-2016.01']
2016-07-26 11:22:08,749 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 11:22:08,749 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,749 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,749 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,749 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,750 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,752 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 11:22:08,753 DEBUG          curator.indexlist          _get_metadata:141  Getting index metadata
2016-07-26 11:22:08,753 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 11:22:09,397 DEBUG          curator.indexlist       _get_index_stats:109  Getting index stats
2016-07-26 11:22:09,397 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 11:22:09,397 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 11:22:09,397 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.20  Size: 625.4MB  Docs: 1073808
2016-07-26 11:22:09,414 DEBUG          curator.indexl
8000
ist     iterate_over_stats:118  Index: logstash-2016.07.13  Size: 782.0MB  Docs: 5868498
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.14  Size: 781.4MB  Docs: 5867804
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.15  Size: 780.1MB  Docs: 5866694
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.16  Size: 772.7MB  Docs: 5865100
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.17  Size: 766.9MB  Docs: 5864406
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.18  Size: 770.4MB  Docs: 5865226
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.19  Size: 769.6MB  Docs: 5865392
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.21  Size: 638.2MB  Docs: 1092220
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.23  Size: 619.1MB  Docs: 1061902
2016-07-26 11:22:09,414 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .kibana  Size: 249.8KB  Docs: 114
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.24  Size: 615.0MB  Docs: 1071450
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.25  Size: 616.1MB  Docs: 1072454
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.26  Size: 458.5MB  Docs: 786982
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.13  Size: 460.3MB  Docs: 1457302
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.15  Size: 452.5MB  Docs: 1434886
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.14  Size: 449.5MB  Docs: 1435384
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.17  Size: 452.1MB  Docs: 1435102
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.16  Size: 452.5MB  Docs: 1435326
2016-07-26 11:22:09,415 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.19  Size: 464.6MB  Docs: 1464818
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.18  Size: 458.3MB  Docs: 1448342
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: squid-2016.07  Size: 221.8MB  Docs: 676778
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: squid-2016.06  Size: 1007.8MB  Docs: 4045432
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: squid-2016.05  Size: 153.7MB  Docs: 845050
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.25  Size: 788.8MB  Docs: 5854906
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.24  Size: 791.2MB  Docs: 5865156
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.07.22  Size: 639.7MB  Docs: 1092084
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.26  Size: 645.1MB  Docs: 4252144
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.21  Size: 781.9MB  Docs: 5865306
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.20  Size: 771.5MB  Docs: 5866468
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.23  Size: 781.6MB  Docs: 5864324
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: logstash-2016.07.22  Size: 783.9MB  Docs: 5866724
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: nxfilter-2016.06  Size: 80.7MB  Docs: 725678
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: nxfilter-2016.07  Size: 156.4MB  Docs: 722068
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.24  Size: 644.6MB  Docs: 1557788
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.25  Size: 632.5MB  Docs: 1558610
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.26  Size: 467.2MB  Docs: 1131094
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.20  Size: 631.8MB  Docs: 1569118
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.21  Size: 656.9MB  Docs: 1588514
2016-07-26 11:22:09,417 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.22  Size: 649.5MB  Docs: 1567138
2016-07-26 11:22:09,418 DEBUG          curator.indexlist     iterate_over_stats:118  Index: topbeat-2016.07.23  Size: 655.2MB  Docs: 1580592
2016-07-26 11:22:09,418 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-data-1  Size: 4.5MB  Docs: 30
2016-07-26 11:22:09,418 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.06  Size: 516.1MB  Docs: 271240
2016-07-26 11:22:09,418 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.07  Size: 278.5MB  Docs: 166468
2016-07-26 11:22:09,418 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.04  Size: 290.9MB  Docs: 275570
2016-07-26 11:22:09,418 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.05  Size: 422.7MB  Docs: 270432
2016-07-26 11:22:09,418 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.03  Size: 424.9MB  Docs: 336976
2016-07-26 11:22:09,418 DEBUG          curator.indexlist     iterate_over_stats:118  Index: packetbeat-2016.01  Size: 1.2GB  Docs: 193962
2016-07-26 11:22:09,418 DEBUG          curator.indexlist        iterate_filters:678  Iterating over a list of filters
2016-07-26 11:22:09,418 DEBUG          curator.indexlist        iterate_filters:684  All filters: [{'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}]
2016-07-26 11:22:09,420 DEBUG          curator.indexlist        iterate_filters:686  Top of the loop: [u'.marvel-es-1-2016.07.20', u'logstash-2016.07.12', u'logstash-2016.07.13', u'logstash-2016.07.14', u'logstash-2016.07.15', u'logstash-2016.07.16', u'.marvel-es-1-2016.07.21', u'logstash-2016.07.18', u'logstash-2016.07.19', u'.marvel-es-1-2016.07.23', u'.kibana', u'.marvel-es-1-2016.07.24', u'logstash-2016.07.20', u'topbeat-2016.07.13', u'topbeat-2016.07.12', u'topbeat-2016.07.15', u'.marvel-es-1-2016.07.26', u'topbeat-2016.07.17', u'topbeat-2016.07.16', u'topbeat-2016.07.19', u'topbeat-2016.07.18', u'logstash-2016.07.17', u'squid-2016.07', u'squid-2016.06', u'squid-2016.05', u'logstash-2016.07.25', u'logstash-2016.07.24', u'.marvel-es-1-2016.07.22', u'logstash-2016.07.26', u'logstash-2016.07.21', u'.marvel-es-1-2016.07.25', u'logstash-2016.07.23', u'logstash-2016.07.22', u'nxfilter-2016.06', u'nxfilter-2016.07', u'topbeat-2016.07.24', u'topbeat-2016.07.25', u'topbeat-2016.07.26', u'topbeat-2016.07.20', u'topbeat-2016.07.21', u'topbeat-2016.07.22', u'topbeat-2016.07.23', u'.marvel-es-data-1', u'topbeat-2016.07.14', u'packetbeat-2016.06', u'packetbeat-2016.07', u'packetbeat-2016.04', u'packetbeat-2016.05', u'packetbeat-2016.03', u'packetbeat-2016.01']
2016-07-26 11:22:09,420 DEBUG              curator.utils        iterate_filters:687  Un-parsed filter args: {'direction': 'younger', 'stats_result': None, 'source': 'creation_date', 'filtertype': 'age', 'field': None, 'epoch': None, 'exclude': None, 'unit_count': 1, 'unit': 'days'}
2016-07-26 11:22:09,420 DEBUG              curator.utils        iterate_filters:713  Filter args: {'direction': 'younger', 'stats_result': 'min_value', 'field': None, 'source': 'creation_date', 'epoch': None, 'timestring': None, 'exclude': False, 'unit_count': 1, 'unit': 'days'}
2016-07-26 11:22:09,420 DEBUG              curator.utils        iterate_filters:714  Pre-instance: [u'.marvel-es-1-2016.07.20', u'logstash-2016.07.12', u'logstash-2016.07.13', u'logstash-2016.07.14', u'logstash-2016.07.15', u'logstash-2016.07.16', u'.marvel-es-1-2016.07.21', u'logstash-2016.07.18', u'logstash-2016.07.19', u'.marvel-es-1-2016.07.23', u'.kibana', u'.marvel-es-1-2016.07.24', u'logstash-2016.07.20', u'topbeat-2016.07.13', u'topbeat-2016.07.12', u'topbeat-2016.07.15', u'.marvel-es-1-2016.07.26', u'topbeat-2016.07.17', u'topbeat-2016.07.16', u'topbeat-2016.07.19', u'topbeat-2016.07.18', u'logstash-2016.07.17', u'squid-2016.07', u'squid-2016.06', u'squid-2016.05', u'logstash-2016.07.25', u'logstash-2016.07.24', u'.marvel-es-1-2016.07.22', u'logstash-2016.07.26', u'logstash-2016.07.21', u'.marvel-es-1-2016.07.25', u'logstash-2016.07.23', u'logstash-2016.07.22', u'nxfilter-2016.06', u'nxfilter-2016.07', u'topbeat-2016.07.24', u'topbeat-2016.07.25', u'topbeat-2016.07.26', u'topbeat-2016.07.20', u'topbeat-2016.07.21', u'topbeat-2016.07.22', u'topbeat-2016.07.23', u'.marvel-es-data-1', u'topbeat-2016.07.14', u'packetbeat-2016.06', u'packetbeat-2016.07', u'packetbeat-2016.04', u'packetbeat-2016.05', u'packetbeat-2016.03', u'packetbeat-2016.01']
2016-07-26 11:22:09,420 DEBUG          curator.indexlist          filter_by_age:338  Filtering indices by age
2016-07-26 11:22:09,420 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 11:22:09,420 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.20 is not actionable, removing from list.
2016-07-26 11:22:09,420 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.20" age (1468972802), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,420 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.12 is not actionable, removing from list.
2016-07-26 11:22:09,420 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.12" age (1468281605), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.13 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.13" age (1468368005), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.14 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.14" age (1468454405), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.15 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.15" age (1468540805), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.16 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.16" age (1468627205), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.21 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.21" age (1469059201), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.18 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.18" age (1468800003), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.19 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.19" age (1468886403), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.23 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.23" age (1469232000), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index .kibana is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".kibana" age (1424476118), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.24 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.24" age (1469318400), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,421 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.20 is not actionable, removing from list.
2016-07-26 11:22:09,421 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.20" age (1468972803), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,423 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.13 is not actionable, removing from list.
2016-07-26 11:22:09,423 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.13" age (1468368007), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,423 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.12 is not actionable, removing from list.
2016-07-26 11:22:09,423 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.12" age (1468281607), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,423 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.15 is not actionable, removing from list.
2016-07-26 11:22:09,423 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.15" age (1468540808), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,423 DEBUG          curator.indexlist           __actionable:34   Index .marvel-es-1-2016.07.26 is actionable and remains in the list.
2016-07-26 11:22:09,423 DEBUG          curator.indexlist            __excludify:57   Remains in actionable list: Index ".marvel-es-1-2016.07.26" age (1469491202), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,423 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.17 is not actionable, removing from list.
2016-07-26 11:22:09,423 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.17" age (1468713608), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,423 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.16 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.16" age (1468627208), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.19 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.19" age (1468886408), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.18 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.18" age (1468800008), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.17 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.17" age (1468713603), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index squid-2016.07 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "squid-2016.07" age (1467331205), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index squid-2016.06 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "squid-2016.06" age (1464739202), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index squid-2016.05 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "squid-2016.05" age (1463693537), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.25 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.25" age (1469404805), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.24 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.24" age (1469318405), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.22 is not actionable, removing from list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.22" age (1469145602), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist           __actionable:34   Index logstash-2016.07.26 is actionable and remains in the list.
2016-07-26 11:22:09,424 DEBUG          curator.indexlist            __excludify:57   Remains in actionable list: Index "logstash-2016.07.26" age (1469491205), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,424 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.21 is not actionable, removing from list.
2016-07-26 11:22:09,426 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.21" age (1469059205), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,426 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.07.25 is not actionable, removing from list.
2016-07-26 11:22:09,426 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-1-2016.07.25" age (1469404800), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,426 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.23 is not actionable, removing from list.
2016-07-26 11:22:09,426 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.23" age (1469232005), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,426 DEBUG          curator.indexlist       __not_actionable:38   Index logstash-2016.07.22 is not actionable, removing from list.
2016-07-26 11:22:09,426 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "logstash-2016.07.22" age (1469145605), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,426 DEBUG          curator.indexlist       __not_actionable:38   Index nxfilter-2016.06 is not actionable, removing from list.
2016-07-26 11:22:09,426 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "nxfilter-2016.06" age (1464899541), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,426 DEBUG          curator.indexlist       __not_actionable:38   Index nxfilter-2016.07 is not actionable, removing from list.
2016-07-26 11:22:09,426 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "nxfilter-2016.07" age (1467331203), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.24 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.24" age (1469318408), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.25 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.25" age (1469404807), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist           __actionable:34   Index topbeat-2016.07.26 is actionable and remains in the list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Remains in actionable list: Index "topbeat-2016.07.26" age (1469491208), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.20 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.20" age (1468972807), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.21 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.21" age (1469059206), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.22 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.22" age (1469145608), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.23 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.23" age (1469232007), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-data-1 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index ".marvel-es-data-1" age (1464979408), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index topbeat-2016.07.14 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "topbeat-2016.07.14" age (1468454407), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.06 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.06" age (1464739226), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,427 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.07 is not actionable, removing from list.
2016-07-26 11:22:09,427 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.07" age (1467331208), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,428 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.04 is not actionable, removing from list.
2016-07-26 11:22:09,428 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.04" age (1459468824), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,428 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.05 is not actionable, removing from list.
2016-07-26 11:22:09,428 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.05" age (1462060888), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,428 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.03 is not actionable, removing from list.
2016-07-26 11:22:09,428 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.03" age (1456790407), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,428 DEBUG          curator.indexlist       __not_actionable:38   Index packetbeat-2016.01 is not actionable, removing from list.
2016-07-26 11:22:09,428 DEBUG          curator.indexlist            __excludify:57   Removed from actionable list: Index "packetbeat-2016.01" age (1452209738), direction: "younger", point of reference, (1469467329)
2016-07-26 11:22:09,428 DEBUG              curator.utils        iterate_filters:716  Post-instance: [u'.marvel-es-1-2016.07.26', u'logstash-2016.07.26', u'topbeat-2016.07.26']
2016-07-26 11:22:09,431 DEBUG              curator.utils      repository_exists:911  Repository Untergeek exists.
2016-07-26 11:22:09,431 DEBUG              curator.utils     parse_date_pattern:995  Partially rendered name: s
2016-07-26 11:22:09,431 DEBUG              curator.utils     parse_date_pattern:995  Partially rendered name: sh
2016-07-26 11:22:09,431 DEBUG              curator.utils     parse_date_pattern:995  Partially rendered name: sha
2016-07-26 11:22:09,431 DEBUG              curator.utils     parse_date_pattern:995  Partially rendered name: shan
2016-07-26 11:22:09,431 DEBUG              curator.utils     parse_date_pattern:997  Fully rendered name: shan
2016-07-26 11:22:09,431 DEBUG                curator.cli         process_action:110  Doing the action here.
2016-07-26 11:22:09,431 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 11:22:09,497 DEBUG              curator.utils           test_repo_fs:927  All nodes can write to the repository
2016-07-26 11:22:09,497 DEBUG              curator.utils           test_repo_fs:929  Nodes with verified repository access: {u'HD9y66SKRleRoj82_eK2bA': {u'name': u'MacBuntu1'}, u'7DVvG6djQFuYxxK-4sIdHQ': {u'name': u'Elasticbox'}, u'-LDbj7sGRmC7zdirMA82rA': {u'name': u'MacBuntu2'}, u'TKH6UI_VQk6GnMk5DE3mbQ': {u'name': u'esmaster'}}
2016-07-26 11:22:09,513 INFO      curator.actions.snapshot              do_action:741  Creating snapshot "shan" from indices: [u'.marvel-es-1-2016.07.26', u'logstash-2016.07.26', u'topbeat-2016.07.26']
2016-07-26 11:22:42,859 INFO      curator.actions.snapshot           report_state:715  Snapshot shan successfully completed.
2016-07-26 11:22:42,859 INFO                 curator.cli                    cli:252  Action #1: completed
2016-07-26 11:22:42,859 INFO                 curator.cli                    cli:253  Job completed.

Again, I cannot replicate this error. What version of Elasticsearch are you using? If pip, which version of Python? What is Elasticsearch running in? Windows?

Also, please attach debug logs with blacklist: [], as I might be able to see some of the calls to Elasticsearch that way. It seems to me that there's something else going on here, since I cannot replicate it with Elasticsearch 2.3.3 and Curator 4.0.3.

@sshantveer
Copy link
Author
  • Elastic version 2.3.3 . This is running on windows.
  • Curator v4.0.3
  • Python 3.6
$ pip --version
pip 8.1.2 from \appdata\local\programs\python\python36\lib\site-packages (python 3.6)

Below are the logs as requested. Made changes to my filter to make sure I include the index I want to take snapshot on :

2016-07-26 18:36:13,797 DEBUG                curator.cli                    cli:165  default_timeout = 30
2016-07-26 18:36:13,800 DEBUG                curator.cli                    cli:170  Full list of actions: {1: {'filters': [{'value': 'som-', 'exclude': None, 'filtertype': 'pattern', 'kind': 'prefix'}], 'description': "Snapshot indices with prefix som- with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'options': {'repository': 'my_backup', 'continue_if_exception': False, 'skip_repo_fs_check': False, 'ignore_unavailable': False, 'partial': False, 'include_global_state': True, 'name': None, 'timeout_override': None, 'disable_action': False, 'wait_for_completion': True}, 'action': 'snapshot'}}
2016-07-26 18:36:13,800 INFO                 curator.cli                    cli:177  Action #1: snapshot
2016-07-26 18:36:13,800 DEBUG                curator.cli                    cli:190  continue_if_exception = False
2016-07-26 18:36:13,800 DEBUG                curator.cli                    cli:191  timeout_override = None
2016-07-26 18:36:13,800 DEBUG              curator.utils             get_client:503  kwargs = {'timeout': 30, 'http_auth': None, 'aws_secret_key': None, 'master_only': False, 'client_key': None, 'aws_key': None, 'ssl_no_validate': False, 'aws_region': None, 'url_prefix': '', 'client_cert': None, 'hosts': ['127.0.0.1'], 'use_ssl': False, 'port': 9200, 'certificate': None}
2016-07-26 18:36:13,801 DEBUG              curator.utils             get_client:548  Not using "requests_aws4auth" python module to connect.
2016-07-26 18:36:13,801 DEBUG         urllib3.util.retry               from_int:170  Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0)
2016-07-26 18:36:13,801 INFO      urllib3.connectionpool              _new_conn:214  Starting new HTTP connection (1): 127.0.0.1
2016-07-26 18:36:13,807 DEBUG     urllib3.connectionpool          _make_request:401  "GET / HTTP/1.1" 200 313
2016-07-26 18:36:13,807 INFO               elasticsearch    log_request_success:63   GET http://127.0.0.1:9200/ [status:200 request:0.006s]
2016-07-26 18:36:13,808 DEBUG              elasticsearch    log_request_success:65   > None
2016-07-26 18:36:13,808 DEBUG              elasticsearch    log_request_success:66   < {
  "name" : "Plug",
  "cluster_name" : "elasticsearch",
  "version" : {
    "number" : "2.3.3",
    "build_hash" : "218bdf10790eef486ff2c41a3df5cfa32dadcfde",
    "build_timestamp" : "2016-05-17T15:40:04Z",
    "build_snapshot" : false,
    "lucene_version" : "5.5.0"
  },
  "tagline" : "You Know, for Search"
}

2016-07-26 18:36:13,808 DEBUG              curator.utils          check_version:412  Detected Elasticsearch version 2.3.3
2016-07-26 18:36:13,808 DEBUG                curator.cli                    cli:216  client is <class 'elasticsearch.client.Elasticsearch' at 0x00000000011B6AA8>
2016-07-26 18:36:13,808 DEBUG                curator.cli                    cli:222  TRY: actions: {'filters': [{'value': 'som-', 'exclude': None, 'filtertype': 'pattern', 'kind': 'prefix'}], 'description': "Snapshot indices with prefix som- with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'options': {'repository': 'my_backup', 'skip_repo_fs_check': False, 'ignore_unavailable': False, 'partial': False, 'include_global_state': True, 'name': None, 'wait_for_completion': True}, 'action': 'snapshot'} kwargs: {'dry_run': False, 'timeout': 30, 'master_timeout': 30}
2016-07-26 18:36:13,808 DEBUG                curator.cli         process_action:46   Configuration dictionary: {'filters': [{'value': 'som-', 'exclude': None, 'filtertype': 'pattern', 'kind': 'prefix'}], 'description': "Snapshot indices with prefix som- with the default snapshot name pattern of 'curator-%Y%m%d%H%M%S'.  Wait for the snapshot to complete.  Do not skip the repository filesystem access check.  Use the other options to create the snapshot.", 'options': {'repository': 'my_backup', 'skip_repo_fs_check': False, 'ignore_unavailable': False, 'partial': False, 'include_global_state': True, 'name': None, 'wait_for_completion': True}, 'action': 'snapshot'}
2016-07-26 18:36:13,808 DEBUG                curator.cli         process_action:47   kwargs: {'dry_run': False, 'timeout': 30, 'master_timeout': 30}
2016-07-26 18:36:13,808 DEBUG                curator.cli         process_action:50   opts: {'repository': 'my_backup', 'skip_repo_fs_check': False, 'ignore_unavailable': False, 'partial': False, 'include_global_state': True, 'name': None, 'wait_for_completion': True}
2016-07-26 18:36:13,808 DEBUG                curator.cli         process_action:68   MYKWARGS = {'repository': None, 'partial': False, 'skip_repo_fs_check': False, 'include_global_state': True, 'ignore_unavailable': False, 'wait_for_completion': True, 'name': 'curator-%Y%m%d%H%M%S'}
2016-07-26 18:36:13,808 DEBUG                curator.cli         process_action:72   Action kwargs: {'repository': 'my_backup', 'partial': False, 'skip_repo_fs_check': False, 'include_global_state': True, 'ignore_unavailable': False, 'wait_for_completion': True, 'name': 'curator-%Y%m%d%H%M%S'}
2016-07-26 18:36:13,808 DEBUG              curator.utils            verify_args:1018 Arguments for action "snapshot": {'repository': 'my_backup', 'partial': False, 'skip_repo_fs_check': False, 'include_global_state': True, 'ignore_unavailable': False, 'wait_for_completion': True, 'name': 'curator-%Y%m%d%H%M%S'}
2016-07-26 18:36:13,809 DEBUG              curator.utils           matches_keys:1022 options.keys = dict_keys(['repository', 'partial', 'skip_repo_fs_check', 'include_global_state', 'ignore_unavailable', 'wait_for_completion', 'name']) mydict.keys = dict_keys(['repository', 'partial', 'skip_repo_fs_check', 'include_global_state', 'ignore_unavailable', 'wait_for_completion', 'name'])
2016-07-26 18:36:13,809 DEBUG                curator.cli         process_action:102  Running "SNAPSHOT"
2016-07-26 18:36:13,809 DEBUG          curator.indexlist          __get_indices:64   Getting all indices
2016-07-26 18:36:13,809 DEBUG         urllib3.util.retry               from_int:170  Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0)
2016-07-26 18:36:13,810 DEBUG     urllib3.connectionpool          _make_request:401  "GET /_all/_settings?expand_wildcards=open%2Cclosed HTTP/1.1" 200 1768
2016-07-26 18:36:13,811 INFO               elasticsearch    log_request_success:63   GET http://127.0.0.1:9200/_all/_settings?expand_wildcards=open%2Cclosed [status:200 request:0.002s]
2016-07-26 18:36:13,811 DEBUG              elasticsearch    log_request_success:65   > None
2016-07-26 18:36:13,811 DEBUG              elasticsearch    log_request_success:66   < {".marvel-es-1-2016.06.29":{"settings":{"index":{"codec":"best_compression","marvel":{"plugin":{"version":"2.3.2"},"template":{"version":"1"}},"number_of_shards":"1","mapper":{"dynamic":"false"},"creation_date":"1467158407084","number_of_replicas":"1","uuid":"j--sbxxGQ5mtW8UVjA_JNQ","version":{"created":"2030299"}}}},".marvel-es-1-2016.06.28":{"settings":{"index":{"codec":"best_compression","marvel":{"plugin":{"version":"2.3.2"},"template":{"version":"1"}},"number_of_shards":"1","mapper":{"dynamic":"false"},"creation_date":"1467072007095","number_of_replicas":"1","uuid":"01lOoc3sQPOugQCb4Ravmw","version":{"created":"2030299"}}}},".marvel-es-1-2016.06.27":{"settings":{"index":{"codec":"best_compression","marvel":{"plugin":{"version":"2.3.2"},"template":{"version":"1"}},"number_of_shards":"1","mapper":{"dynamic":"false"},"creation_date":"1467049266583","number_of_replicas":"1","uuid":"1ikZ0VwkQA67PErklxIZrg","version":{"created":"2030299"}}}},".marvel-es-1-2016.06.30":{"settings":{"index":{"codec":"best_compression","marvel":{"plugin":{"version":"2.3.2"},"template":{"version":"1"}},"number_of_shards":"1","mapper":{"dynamic":"false"},"creation_date":"1467244806166","number_of_replicas":"1","uuid":"Yf4gG2iLSQ6G3xpJkRIthQ","version":{"created":"2030299"}}}},".marvel-es-data-1":{"settings":{"index":{"codec":"best_compression","marvel":{"plugin":{"version":"2.3.2"},"template":{"version":"1"}},"number_of_shards":"1","mapper":{"dynamic":"false"},"creation_date":"1467049266368","number_of_replicas":"1","uuid":"WSxnea9gS9-psO2bLepn2A","version":{"created":"2030299"}}}},"som-claim-1":{"settings":{"index":{"creation_date":"1467333351569","number_of_shards":"5","number_of_replicas":"1","uuid":"7Fc0Smp0QzyoUG19LydoBA","version":{"created":"2030399"}}}}}
2016-07-26 18:36:13,811 DEBUG              curator.utils            get_indices:369  All indices: ['som-claim-1', '.marvel-es-1-2016.06.27', '.marvel-es-1-2016.06.30', '.marvel-es-1-2016.06.29', '.marvel-es-1-2016.06.28', '.marvel-es-data-1']
2016-07-26 18:36:13,811 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 18:36:13,812 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:36:13,812 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:36:13,812 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:36:13,812 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:36:13,812 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:36:13,812 DEBUG          curator.indexlist     __build_index_info:78   Building index info dictionary
2016-07-26 18:36:13,812 DEBUG          curator.indexlist          _get_metadata:141  Getting index metadata
2016-07-26 18:36:13,812 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 18:36:13,812 DEBUG         urllib3.util.retry               from_int:170  Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0)
2016-07-26 18:36:13,815 DEBUG     urllib3.connectionpool          _make_request:401  "GET /_cluster/state/metadata/.marvel-es-1-2016.06.27,.marvel-es-1-2016.06.28,.marvel-es-1-2016.06.29,.marvel-es-1-2016.06.30,.marvel-es-data-1,som-claim-1 HTTP/1.1" 200 48668
2016-07-26 18:36:13,816 INFO               elasticsearch    log_request_success:63   GET http://127.0.0.1:9200/_cluster/state/metadata/.marvel-es-1-2016.06.27,.marvel-es-1-2016.06.28,.marvel-es-1-2016.06.29,.marvel-es-1-2016.06.30,.marvel-es-data-1,som-claim-1 [status:200 request:0.004s]
2016-07-26 18:36:13,816 DEBUG              elasticsearch    log_request_success:65   > None
2016-07-26 18:36:13,832 DEBUG          curator.indexlist       _get_index_stats:109  Getting index stats
2016-07-26 18:36:13,832 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 18:36:13,832 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 18:36:13,832 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 18:36:13,832 DEBUG         urllib3.util.retry               from_int:170  Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0)
2016-07-26 18:36:13,907 DEBUG     urllib3.connectionpool          _make_request:401  "GET /.marvel-es-1-2016.06.27,.marvel-es-1-2016.06.28,.marvel-es-1-2016.06.29,.marvel-es-1-2016.06.30,.marvel-es-data-1,som-claim-1/_stats/store,docs HTTP/1.1" 200 1766
2016-07-26 18:36:13,908 INFO               elasticsearch    log_request_success:63   GET http://127.0.0.1:9200/.marvel-es-1-2016.06.27,.marvel-es-1-2016.06.28,.marvel-es-1-2016.06.29,.marvel-es-1-2016.06.30,.marvel-es-data-1,som-claim-1/_stats/store,docs [status:200 request:0.076s]
2016-07-26 18:36:13,908 DEBUG              elasticsearch    log_request_success:65   > None
2016-07-26 18:36:13,908 DEBUG              elasticsearch    log_request_success:66   < {"_shards":{"total":20,"successful":10,"failed":0},"_all":{"primaries":{"docs":{"count":255234,"deleted":397},"store":{"size_in_bytes":106390989,"throttle_time_in_millis":0}},"total":{"docs":{"count":255234,"deleted":397},"store":{"size_in_bytes":106390989,"throttle_time_in_millis":0}}},"indices":{".marvel-es-1-2016.06.30":{"primaries":{"docs":{"count":77987,"deleted":150},"store":{"size_in_bytes":27378552,"throttle_time_in_millis":0}},"total":{"docs":{"count":77987,"deleted":150},"store":{"size_in_bytes":27378552,"throttle_time_in_millis":0}}},".marvel-es-data-1":{"primaries":{"docs":{"count":10,"deleted":8},"store":{"size_in_bytes":34456,"throttle_time_in_millis":0}},"total":{"docs":{"count":10,"deleted":8},"store":{"size_in_bytes":34456,"throttle_time_in_millis":0}}},".marvel-es-1-2016.06.29":{"primaries":{"docs":{"count":92236,"deleted":109},"store":{"size_in_bytes":29257327,"throttle_time_in_millis":0}},"total":{"docs":{"count":92236,"deleted":109},"store":{"size_in_bytes":29257327,"throttle_time_in_millis":0}}},".marvel-es-1-2016.06.28":{"primaries":{"docs":{"count":28333,"deleted":32},"store":{"size_in_bytes":9151537,"throttle_time_in_millis":0}},"total":{"docs":{"count":28333,"deleted":32},"store":{"size_in_bytes":9151537,"throttle_time_in_millis":0}}},".marvel-es-1-2016.06.27":{"primaries":{"docs":{"count":20786,"deleted":98},"store":{"size_in_bytes":7321700,"throttle_time_in_millis":0}},"total":{"docs":{"count":20786,"deleted":98},"store":{"size_in_bytes":7321700,"throttle_time_in_millis":0}}},"som-claim-1":{"primaries":{"docs":{"count":35882,"deleted":0},"store":{"size_in_bytes":33247417,"throttle_time_in_millis":0}},"total":{"docs":{"count":35882,"deleted":0},"store":{"size_in_bytes":33247417,"throttle_time_in_millis":0}}}}}
2016-07-26 18:36:13,908 DEBUG          curator.indexlist     iterate_over_stats:118  Index: som-claim-1  Size: 31.7MB  Docs: 35882
2016-07-26 18:36:13,908 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.06.27  Size: 7.0MB  Docs: 20786
2016-07-26 18:36:13,908 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.06.30  Size: 26.1MB  Docs: 77987
2016-07-26 18:36:13,909 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.06.29  Size: 27.9MB  Docs: 92236
2016-07-26 18:36:13,909 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-1-2016.06.28  Size: 8.7MB  Docs: 28333
2016-07-26 18:36:13,909 DEBUG          curator.indexlist     iterate_over_stats:118  Index: .marvel-es-data-1  Size: 33.6KB  Docs: 10
2016-07-26 18:36:13,909 DEBUG          curator.indexlist        iterate_filters:678  Iterating over a list of filters
2016-07-26 18:36:13,909 DEBUG          curator.indexlist        iterate_filters:684  All filters: [{'value': 'som-', 'exclude': None, 'filtertype': 'pattern', 'kind': 'prefix'}]
2016-07-26 18:36:13,909 DEBUG          curator.indexlist        iterate_filters:686  Top of the loop: ['som-claim-1', '.marvel-es-1-2016.06.27', '.marvel-es-1-2016.06.30', '.marvel-es-1-2016.06.29', '.marvel-es-1-2016.06.28', '.marvel-es-data-1']
2016-07-26 18:36:13,909 DEBUG              curator.utils        iterate_filters:687  Un-parsed filter args: {'value': 'som-', 'exclude': None, 'filtertype': 'pattern', 'kind': 'prefix'}
2016-07-26 18:36:13,909 DEBUG              curator.utils        iterate_filters:713  Filter args: {'value': 'som-', 'exclude': False, 'kind': 'prefix'}
2016-07-26 18:36:13,909 DEBUG              curator.utils        iterate_filters:714  Pre-instance: ['som-claim-1', '.marvel-es-1-2016.06.27', '.marvel-es-1-2016.06.30', '.marvel-es-1-2016.06.29', '.marvel-es-1-2016.06.28', '.marvel-es-data-1']
2016-07-26 18:36:13,909 DEBUG          curator.indexlist        filter_by_regex:280  Filtering indices by regex
2016-07-26 18:36:13,909 DEBUG          curator.indexlist       empty_list_check:178  Checking for empty list
2016-07-26 18:36:13,909 DEBUG          curator.indexlist           working_list:189  Generating working list of indices
2016-07-26 18:36:13,909 DEBUG          curator.indexlist        filter_by_regex:301  Filter by regex: Index: som-claim-1
2016-07-26 18:36:13,909 DEBUG          curator.indexlist           __actionable:34   Index som-claim-1 is actionable and remains in the list.
2016-07-26 18:36:13,909 DEBUG          curator.indexlist        filter_by_regex:301  Filter by regex: Index: .marvel-es-1-2016.06.27
2016-07-26 18:36:13,910 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.06.27 is not actionable, removing from list.
2016-07-26 18:36:13,910 DEBUG          curator.indexlist        filter_by_regex:301  Filter by regex: Index: .marvel-es-1-2016.06.30
2016-07-26 18:36:13,910 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.06.30 is not actionable, removing from list.
2016-07-26 18:36:13,910 DEBUG          curator.indexlist        filter_by_regex:301  Filter by regex: Index: .marvel-es-1-2016.06.29
2016-07-26 18:36:13,910 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.06.29 is not actionable, removing from list.
2016-07-26 18:36:13,910 DEBUG          curator.indexlist        filter_by_regex:301  Filter by regex: Index: .marvel-es-1-2016.06.28
2016-07-26 18:36:13,910 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-1-2016.06.28 is not actionable, removing from list.
2016-07-26 18:36:13,910 DEBUG          curator.indexlist        filter_by_regex:301  Filter by regex: Index: .marvel-es-data-1
2016-07-26 18:36:13,910 DEBUG          curator.indexlist       __not_actionable:38   Index .marvel-es-data-1 is not actionable, removing from list.
2016-07-26 18:36:13,910 DEBUG              curator.utils        iterate_filters:716  Post-instance: ['som-claim-1']
2016-07-26 18:36:13,910 ERROR                curator.cli                    cli:242  Failed to complete action: snapshot.  <class 'TypeError' at 0x000000001D8AC400>: Not an IndexList object. Type: <class 'curator.indexlist.IndexList' at 0x0000000002D839B8>.

@untergeek
Copy link
Member

Python 3.6 is a development branch, isn't it? It's only at 3.6.0a3 as of July 12, 2016, from what I can tell. I be able to easily test against pre-release versions in Travis CI. The most recent stable branch is 3.5.2, as of 2016-06-27. You had the problem with the MSI, which should have been using an isolated, localized and precompiled version of Python 2.7. If you're using a development release of Python, that might have something to do with it. I confess that the error <class 'TypeError' at 0x000000001D8AC400> seems to not match other errors I am accustomed to seeing.

The code that raises this TypeError is at: https://github.com/elastic/curator/blob/master/curator/utils.py#L88. It works in Python 2.6, 2.7, 3.4, and 3.5. It may be some change in 3.6 (if you really are using a pre-release of Python) is not working with this change.

@sshantveer
Copy link
Author

Thanks @untergeek . It was Python version.
I tried with python v3.5.2, it worked.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
cannot_replicate question
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@untergeek @sshantveer
0