is it posible launch another pool inside a thread? #60

CriztianiX · 2016-04-26T01:54:58Z

See this piece of code:

local threads = require 'threads'
local parser = require("parser")["discounts"]
local config = require("lapis.config").get()

-- Returns paginator instance
local paginator = function()
    local model = require("models")["discounts"]
    return model:paginated(model:query())
end
-- Returns elasticsearch client
local elasticsearch = function()
    local elasticsearch = require "elasticsearch"
    return elasticsearch.client{
      hosts = config.elasticsearch.hosts
  }
end

local nthread = config.nthread
local pages = paginator():num_pages()
local pool = threads.Threads(
   nthread,
   function(threadid)
      paginated = paginator()
      client = elasticsearch()
      from_json = require("lapis.util").from_json
      es_type = paginated.model:table_name()
      print('starting a new thread/state number ' .. threadid)
   end
)

local jobdone = 0
for i=1,pages do
   pool:addjob(function()
       local items = paginated:get_page(i)
     for i=1,#items do
       local data, err = client:index({
          index = config.elasticsearch.index,
                type = es_type,
          id = items[i].id,
          body = parser(items[i])
         })
     end
    return __threadid
   end,
   function(id)
      jobdone = jobdone + 1
   end)
end

pool:synchronize()
print(string.format('%d jobs done', jobdone))
pool:terminate()

So, can i create another pool inside pool:addjob() ?

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

is it posible launch another pool inside a thread? #60

is it posible launch another pool inside a thread? #60

is it posible launch another pool inside a thread? #60

is it posible launch another pool inside a thread? #60

Comments