Very neat lectures by Feynman on electricity: https://www.feynmanlectures.caltech.edu/II_01.html#Ch1-S1
This morning for some reason I started to think about making a manufacturing company in the US. I was thinking about how we import so much from other countries that wouldn’t it be neat if from raw materials we build something that people would buy. So, the thought process was then like oh boy, what resources do we have that we can actually produce things that are sustainable.
Trash! Obviously this is something we have in abundance. However, the stuff that gets sent to landfills is not being used well. It just sits there… Some companies are “up-cycling” (taking things like plastic bottles and producing a more expensive product) plastic bottles and producing shoes and hand bags (https://www.veja-store.com/en_uk/c/men).
But, what about all the trash in land fills. What can we do with that? So, I googled and found:
Very neat website that has a lot of useful info. It seems like we burn a lot of the stuff that ends up in landfills and this creates electricity by using the heat to turn a generator. This also reduces the mass and volume of the waste. However, you are still producing CO2. Which is not as bad as methane in terms of green house gas, but is still not ideal.
I also found that landfills also produce biogas: https://www.eia.gov/energyexplained/biomass/landfill-gas-and-biogas.php
Gasses such as methane and carbon dioxide (CO2) are considered “biogases”. These gases can be burned to produce electricity. Not only landfills are doing this, but also farms. The farms collect manure in “manure lagoons” and the methane captured from these ponds is used to produce electricty.
Biomass such as organic solid waste, crop residue, etc. can be converted to hydrogen and CO2: https://www.energy.gov/eere/fuelcells/hydrogen-production-biomass-gasification. The hydrogen could then be used for powering vehicles etc. This type of waste seems to be in abundance as well. This article (https://www.energy.gov/sites/prod/files/2015/01/f19/billion_ton_update_0.pdf) suggests that we will produce 1 billion tons of biomass year. This article was written in 2011!!!
The great part they claim is that there is low net green house gas produced since biomass uses CO2 during its growth process. This is very interesting.
So, we still don’t have a clear idea on the whole original question of building a manufacturing plant that uses renewables. But, maybe next time.
I think it might be helpful in the future to not just have json data be just the dataset but also contain pickled functions that can be used by the end user to easily access the data in a way that works for their application. Dill can be used to serialize a python function or class (though no security is assumed). Then stick that serialized function into the json and use that to read the dataset. Would be much nicer to just say that everyone needs to provide functions to their dataset that are easily obtained. Since these are arbitrary functions this is very very dangerous so I’d only recommend using for data that you wrote yourself… So, this sort of defeats the purpose…
Multiagent Soft Q-Learning
Ermo Wei, Drew Wicke, David Freelan, Sean Luke
We published this in AAAI Spring Symposium 2018.
Hierarchical Approaches for Reinforcement Learning in Parameterized Action Space
Ermo Wei, Drew Wicke, Sean Luke
We published this in AAAI Spring Symposium 2018.
Here is a link to the paper
Really nice article on the fourier transform and also some other math explained more intuitively here.
Looks like a neat meet-up/website.
My original bounty hunting paper could actually be considered a market implementation of the Highest Response Ratio Next.
The bounty assigned to tasks is set to some base bounty and a bounty rate $latex r$ which in the first bounty hunting paper was set to 100 and 1 respectively. So, as each tasks was left undone the bounty on it would rise. Tasks belong to particular “task classes” which basically means that there location is drawn from the same gaussian distribution. In the paper we used 20 task classes and there were four agents. The four agents were located at each of the four corners of a 40×60 rectangular grid. The agents decide which task to go after based on which task has the highest bounty per time step which works out to be:
This is for the case when agents commit to tasks and are not allowed to abandon them. Essentially non-preemptive. When the agents are allowed to abandon tasks we then have:
Both of these equations are stating that the agents are going after the task in an HRRN order. Now, the key part that bounty hunting added was that it made it work in a multiagent setting. This is where they learned some probability of success of going after the particular task class . Also, the paper experimentally demonstrated some other nice properties of bounty hunting based task allocation in a dynamic setting.
Presently I’m taking this approach and moving it to dynamic vehicle routing setting where I use it to minimize the average waiting time of tasks where the agent doesn’t get teleported back to a home base after each task completion. Namely the dynamic multiagent traveling repairman problem. This is another setting where the Shortest Job Next (Nearest Neighbor in euclidean space) is a descent heuristic and because the agents are not reset causes interesting behavior with a non-zero bounty rate.
Oh yeah, blog, I totally forgot to mention, I PASSED MY COMPREHENSIVE EXAM AND DISSERTATION PROPOSAL!!!!!!
So, I have been reading about the effectiveness of the current methods for determining the efficiency of fire stations. Most fire stations look at efficiency by cutting there budgets. Their argument is that basically lowering input (the budget) is not a good measure of efficiency. They argue that you have to look at the value of the property saved
“the mission of the fire service is to be resilient and fast, not necessarily efficient”
Efficiency would mean minimizing costs. Essentially, this is reducing the budget. In disasters we need speed, resiliency, and sustainability. Currently bounty hunting doesn’t minimize the budget.
A bounty hunting system gives the agents more autonomy to chose the task they want to do rather than being governed by the results of the auction.
Would incorporating different types of bounty hunting strategies rather than just maximize the current bounty alone be the most effective approach?
I’ve already since starting this post have created a measure for speed and the jumpship bounty hunters are quite good at being speedy even under adverse situations in comparison to auction methods.