-
Notifications
You must be signed in to change notification settings - Fork 0
/
index.html
executable file
·167 lines (138 loc) · 11.6 KB
/
index.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
<!DOCTYPE html>
<html>
<head>
<title>Home | Afshin Oroojlooy</title>
<!-- link to main stylesheet -->
<!-- google link -->
<link rel="stylesheet" type="text/css" href="/css/main.css">
<script async src="//pagead2.googlesyndication.com/pagead/js/adsbygoogle.js"></script>
<script>
(adsbygoogle = window.adsbygoogle || []).push({
google_ad_client: "ca-pub-6450469430752222",
enable_page_level_ads: true
});
</script>
</head>
<body>
<nav>
<ul>
<li><a href="/">Home</a></li>
<li><a href="/publications">Publications</a></li>
<li><a href="/cv">CV</a></li>
<li><a href="/blog">Blog</a></li>
</ul>
</nav>
<div class="container">
<div class="blurb">
<h1>Hi there, I'm Afshin Oroojlooy!</h1>
<p>I am a principal applied scientists at Oracle OCI where I focused mostly on applications of reinforcement learning and operations research to solve large scale real-world problems. Before joining Oracle, I was a senior RL research scientist at SAS Institute where I spend about 5 years to learn how to build production level machine learning solutions.
<p>My current research is focused on the extension of Reinforcement Learning algorithms for real-world problems, e.g. inventory optimization on multi-echelon networks, traveling salesman problem, stochastic vendor route problem, customer journey optimization, Traffic signal control, HVAC, manufacturing control problems, etc. You can see details of them in my <a href="/publications">publications</a> or read some overview on <a href="/blog">my Blog...</a></p>
<p>My journey on reinforcement learning started by on the industrial engineering department at <a href="http://www.lehigh.edu/ise/"> Lehigh University</a>, where I had the pleasure to work under the supervision of Professor <a href="http://coral.ise.lehigh.edu/larry/">Larry Snyder</a> and Professor <a href="http://mtakac.com/">Martin Takac</a>. The goal of my dissertation was to extend machine learning and specially reinforcement learning algorithms to solve combinatorial optimization problems in supply chain problems. I got my M.S. of Industrial Engineering from <a href="http://www.en.sharif.edu/"> Sharif University of Technology</a> and B.S of Industrial Engineering from <a href="http://iut.ac.ir/en/"> Isfahan University of Technology</a></p>.
Please find my resume <a href="/cv">Here</a> (updated on 07/10/2021).
<font size="+2"> <p> Updates: </p> </font>
<div class="container">
<div class="blurb">
<!-- <figure> -->
<table style="width:90%">
<col width="10%">
<col width="75%">
<col width="15%">
<tr>
<th> 06/22/2022 </th>
<td> Our review <a href="https://link.springer.com/article/10.1007/s10489-022-04105-y"> paper </a> on multi-agent cooperative RL is got online on <a href="https://www.springer.com/journal/10489"> Applied Intelligence </a>> </td>
<td><img src="springer.png" width="125" height="72"/> </td>
<tr>
<th> 06/22/2022 </th>
<td> I joined to Oracle OCI as a principal applied scientists!</td>
<td><img src="oracle.png" width="125" height="125"/> </td>
<tr>
<th> 04/02/2021 </th>
<td> I am presenting " An Introduction to RL and its Applications in Supply Chain Management" at a side workshop at IIISE online conference!. </td>
<td><img src="Rl_agent.png" width="146" height="95"/> </td>
<tr>
<th> 11/08/2020 </th>
<td> I am attending <a href="http://meetings2.informs.org/wordpress/annual2020/"> INFORMS Annual Meeting 2020</a> conference, Online!. I am presenting our new work on traffic signal processing and a review on one section of our MARL review papers, and co-presenting our another presentation on MARL review. </td>
<td><a href="http://meetings2.informs.org/wordpress/annual2020/"> <img src="informs_20.png" alt="INFORMS20" width="60" height="50"/> </a> </td>
<tr>
<th> 09/27/2020 </th>
<td> Our work on application of RL for a traffic signal control accepted on NeurIPS 2020, Vancouver, CA. See the paper [<a href="https://proceedings.neurips.cc/paper/2020/file/29e48b79ae6fc68e9b6480b677453586-Paper.pdf">here</a>] </td>
<td><a href="https://neurips.cc/"> <img src="nips_logo.png" alt="NeurIPS" width="150" height="75"/> </a> </td>
<tr>
<th> 06/25/2020 </th>
<td> The <a href="https://doi.org/10.1287/msom.2020.0939"> beer game paper</a> is accepted on Manufacturing and Service Operations Management (MSOM). Read more about it at <a href="https://oroojlooy.github.io/blog/beer_game/"> blog </a>. We also released the code of paper at <a href="https://github.com/OptMLGroup/DeepBeerInventory-RL">github</a> </td>
<td><a href="https://pubsonline.informs.org/journal/msom"> <img src="MSOM.png" alt="MSOM" width="223" height="39"/> </a> </td>
<tr>
<th> 08/11/2019 </th>
<td> Our review <a href="https://arxiv.org/abs/1908.03963"> paper </a> on multi-agent cooperative RL is out !. </td>
<tr>
<th> 06/12/2019 </th>
<td> I am attending <a href="https://icml.cc/2019"> ICML </a> 2019 conference and workshop!. </td>
<td><a href="https://icml.cc/2019"> <img src="icml.png" alt="ICML" width="131" height="53"/> </a> </td>
<tr>
<th> 06/04/2019 </th>
<td> The newsvendor paper is accepted on Institute of Industrial and Systems Engineers (IISE) Transaction. Read more about it at <a href="https://oroojlooy.github.io/blog/newsvendor//"> blog </a>. We also released the code of paper at <a href="https://github.com/oroojlooy/newsvendor">github</a>. </td>
<td><a href="https://www.tandfonline.com/toc/uiie21/current"> <img src="iise.png" alt="IISE" width="131" height="21"/> </a> </td>
<tr>
<th> 11/04/2018 </th>
<td> I am attending <a href="https://www.informs.org/Meetings-Conferences/INFORMS-Conference-Calendar/2018-INFORMS-Annual-Meeting-Phoenix"> INFORMS Annual Meeting 2018</a> conference at Phoenix, AZ!. I am presenting our Beer-Game paper, and co-presenting our VRP paper. </td>
<td><a href="https://www.informs.org/Meetings-Conferences/INFORMS-Conference-Calendar/2018-INFORMS-Annual-Meeting-Phoenix"> <img src="informs_18.png" alt="INFORMS18" width="111" height="51"/> </a> </td>
<tr>
<th> 09/16/2018 </th>
<td> I Started my full time position as a RL research Scientist at <a href="https://www.sas.com/en_us/home.html"> SAS Institute </a>. </td>
<td><a href="https://www.sas.com/en_us/home.html"> <img src="sas.jpg" alt="SAS Institute" width="111" height="45"/> </a> </td>
<tr>
<th> 09/13/2018 </th>
<td> I successfully defended! my dissertation at the <a href="https://engineering.lehigh.edu/ise"> ISE Department of the Lehigh University</a>. </td>
<td><a href="https://engineering.lehigh.edu/ise"> <img src="lehigh.jpg" alt="Lehigh University" width="171" height="42"/> </a> </td>
<tr>
<th> 09/04/2018 </th>
<td> Our RL for VRP paper is accepted at <a href="https://papers.nips.cc/paper/8190-reinforcement-learning-for-solving-the-vehicle-routing-problem"> NeurIPS 2018 </a> .!
<a href="https://papers.nips.cc/paper/8190-reinforcement-learning-for-solving-the-vehicle-routing-problem"> See the code [<a href="https://github.com/OptMLGroup/VRP-RL">here</a>] </td>
<td><img src="201081027_nips.png" alt="NIPS" width="74" height="68"/> </a> </td>
<tr>
<th> 03/09/2018 </th>
<td> Opex Analytics released an <a href="https://beergame.opexanalytics.com"> online </a> free version of beer game which uses our AI engine. Try it to see if you can beat the AI! </td>
<td><a href="https://beergame.opexanalytics.com"> <img src="opex_beergame.jpg" alt="Opex Analytics Beer Game" width="156" height="80"/> </a> </td>
<tr>
<th> 08/10/2018 </th>
<td> I am attending <a href="https://coral.ise.lehigh.edu/~mopta2018/"> Modeling and Optimization: Theory and Applications (MOPTA) 2018</a> conference at Bethlehem, PA!. I am presenting our RL for beer game paper and I am co-presenting our RL for VRP paper. </td>
<td><a href="https://coral.ise.lehigh.edu/~mopta2018/"> <img src="mopta.png" alt="MOPTA2018" width="122" height="100"/> </a> </td>
<tr>
<th> 10/22/2017 </th>
<td> I am attending <a href="http://meetings2.informs.org/wordpress/houston2017/#:~:text=Now%20more%20than%20four%20decades%20later%2C%20INFORMS%20will,breaking%20ideas%20at%20the%202017%20INFORMS%20Annual%20Meeting."> INFORMS Annual Meeting 2017</a> conference at Houston, AZ!. I am presenting some initial results on our Beer-Game paper. </td>
<td><a href="http://meetings2.informs.org/wordpress/houston2017/#:~:text=Now%20more%20than%20four%20decades%20later%2C%20INFORMS%20will,breaking%20ideas%20at%20the%202017%20INFORMS%20Annual%20Meeting."> <img src="informs_17.png" alt="INFORMS17" width="91" height="93"/> </a> </td>
<tr>
<th> 08/16/2017 </th>
<td> I am attending <a href="https://coral.ise.lehigh.edu/~mopta2017/"> Modeling and Optimization: Theory and Applications (MOPTA) 2017</a> conference at Bethlehem, PA!. I am presenting our Newsvendor paper and multi-echelon stockout prediction. </td>
<td><a href="https://coral.ise.lehigh.edu/~mopta2017/"> <img src="mopta.png" alt="MOPTA2017" width="122" height="100"/> </a> </td>
<tr>
<th> 06/01/2017 </th>
<td> I Started my internship at RL team at <a href="https://www.sas.com/en_us/home.html"> SAS Institute </a>. </td>
<td><a href="https://www.sas.com/en_us/home.html"> <img src="sas.jpg" alt="SAS Institute" width="111" height="45"/> </a> </td>
<tr>
<th> 11/13/2016 </th>
<td> I am attending <a href="http://meetings2.informs.org/wordpress/nashville2016/."> INFORMS Annual Meeting 2016</a> conference at Nashville, TN!. I am presenting our Newsvendor paper. </td>
<td><a href="http://meetings2.informs.org/wordpress/nashville2016/."> <img src="informs_16.png" alt="INFORMS16" width="111" height="55"/> </a> </td>
<tr>
<th> 08/04/2015 </th>
<td> I serving as a system administrator in <a href="http://coral.ise.lehigh.edu/">COR@L</a> Lab, Lehigh ISE's high performance computing center.</td>
<td><a href="http://meetings2.informs.org/wordpress/nashville2016/."> <img src="coral.png" alt="GlobalSIP" width="120" height="35"/> </a> </td>
<tr>
<th> 08/04/2015 </th>
<td> Our <a href="https://ieeexplore.ieee.org/abstract/document/7418344"> paper</a>, "Optimal scheduling of networked energy storages" accepted at IEEE Global Conference on Signal and Information Processing (GlobalSIP) conference at Orlando, FL!. </td>
<td><a href="http://meetings2.informs.org/wordpress/nashville2016/."> <img src="globalsip.png" alt="GlobalSIP" width="104" height="35"/> </a> </td>
</table>
</div><!-- /.blurb -->
</div><!-- /.container -->
</div><!-- /.blurb -->
</div><!-- /.container -->
<footer>
<ul>
<li><a href="mailto:[email protected]">email</a></li>
<!-- <li><a href="https://github.com/oroojlooy">github.com/oroojlooy</a></li> -->
<li><a href="https://scholar.google.com/citations?user=7nEdMAMAAAAJ&hl=en">Google Scholar</a></li>
<li><a href="https://www.linkedin.com/in/afshin-oroojlooy-81663b38/">LinkedIn</a></li>
</ul>
</footer>
</body>
</html>