We provide four types of scenes.
StadiumScene: they are simple scenes with flat grounds and no obstacles, useful for debugging purposes.
StaticIndoorScene: it loads static 3D scenes from
InteractiveIndoorScene: it loads fully interactive 3D scenes from
Typically, they take in the
scene_id of a scene and provide a
load function that be invoked externally (usually by
import_ig_scene of the
To be more specific, the
load function of
stores the floor information (we have many multistory houses in our dataset)
loads the scene mesh into PyBullet
builds an internal traversability graph for each floor based on the traversability maps stored in the scene folder (e.g.
provides APIs for sampling a random location in the scene, and for computing the shortest path between two locations in the scene.
In addition to everything mentioned above, the
load function of
provides material/texture randomization functionality: randomize the material, texture and dynamic property of scene object models
provides object randomization functionality: randomize scene object models while keeping object poses and categories intact
provides scene quality check: check if object models have collisions and if fixed, articulated objects can extend their joints fully without collision
provides partial scene loading functionality: 1) only load objects of certain categories, 2) only load objects in certain room types, 3) only load objects in certain room instances.
provides APIs for changing the state of articulated objects (e.g. open all “fridges” and “ovens” in the scene)
Most of the code can be found here: igibson/scenes.
Adding other scenes to iGibson¶
We provide detailed instructions and scripts to import scenes from the following sources into iGibson:
CubiCasa5k: A Dataset and an Improved Multi-Task Model for Floorplan Image Analysis. (Kalervo, Ahti, et al.)
3D-FRONT: 3D Furnished Rooms with layOuts and semaNTics. (Fu, Huanl, et al.)
Instruction can be found here: External Scenes.
In this example, we import a simple stadium scene that is good for debugging. The code can be found here: igibson/examples/demo/scene_stadium_example.py.
from igibson.scenes.stadium_scene import StadiumScene import pybullet as p import numpy as np import time def main(): p.connect(p.GUI) p.setGravity(0,0,-9.8) p.setTimeStep(1./240.) scene = StadiumScene() scene.load() for _ in range(24000): # at least 100 seconds p.stepSimulation() time.sleep(1./240.) p.disconnect() if __name__ == '__main__': main()
The stadium scene looks like this:
Static Building Scenes¶
In this example, we import a static scene, and then randomly sample a pair of locations in the scene and compuete the shortest path between them. The code can be found here: igibson/examples/demo/scene_example.py.
from igibson.scenes.gibson_indoor_scene import StaticIndoorScene import pybullet as p import numpy as np import time def main(): p.connect(p.GUI) p.setGravity(0,0,-9.8) p.setTimeStep(1./240.) scene = BuildingScene('Rs', build_graph=True, pybullet_load_texture=True) scene.load() np.random.seed(0) for _ in range(10): random_floor = scene.get_random_floor() p1 = scene.get_random_point(floor=random_floor) p2 = scene.get_random_point(floor=random_floor) shortest_path, geodesic_distance = scene.get_shortest_path(random_floor, p1[:2], p2[:2], entire_path=True) print('random point 1:', p1) print('random point 2:', p2) print('geodesic distance between p1 and p2', geodesic_distance) print('shortest path from p1 to p2:', shortest_path) for _ in range(24000): # at least 100 seconds p.stepSimulation() time.sleep(1./240.) p.disconnect() if __name__ == '__main__': main()
Interactive Building Scenes¶
In this example, we import a fully interactive scene, and randomly sample points given a room type such as “living_room”. This can be useful for tasks that require the robot to always be spawned in certain room types. We support fifteen such scenes right now as part of the new iGibson Dataset. The code can be found here: igibson/examples/demo/scene_interactive_example.py.
Note that all objects in these scenes can be interacted realistically.
from igibson.scenes.igibson_indoor_scene import InteractiveIndoorScene from igibson.simulator import Simulator import numpy as np def main(): s = Simulator(mode='gui', image_width=512, image_height=512, device_idx=0) scene = InteractiveIndoorScene( 'Rs_int', texture_randomization=False, object_randomization=False) s.import_ig_scene(scene) np.random.seed(0) for _ in range(10): pt = scene.get_random_point_by_room_type('living_room') print('random point in living_room', pt) for _ in range(1000): s.step() s.disconnect() if __name__ == '__main__': main()
In this example, we demonstrate material/texture randomization functionality of
InteractiveIndoorScene. The goal is to randomize the material, texture and dynamic properties of all scene objects by calling
scene.randomize_texture on-demand. The code can be found here: igibson/examples/demo/scene_interactive_texture_rand_example.py.
The randomized materials in the
ExternalView window should look like this.
In this example, we demonstrate object randomization functionality of
InteractiveIndoorScene. The goal is to randomize the object models while maintaining their poses and categories. Note that when object models are randomized, there is no guarantee that they have no collisions or the fixed, articulated objects can extend their joints without collision. We provide
scene.check_scene_quality functionality to check scene quality and you should do object model re-sampling if this function returns
False. An alternative way (recommended) is to use randoml object model configuration that we provide (10 for each scenes) which guarantees scene quality, by passing in
object_randomization_idx=[0-9]. Finally, object randomization can be expensive because the new object models need to be loaded to the simulator each time, so we recommend only using it occasionally (e.g. every 1000 training episodes). The code can be found here: igibson/examples/demo/scene_interactive_object_rand_example.py.
The randomized object models in the
ExternalView window should look like this.
Partial Scene Loading¶
In this example, we demonstrate partial scene loading functionality of
InteractiveIndoorScene. Specifically in this example we only load “chairs” in “living rooms”. This can be useful for tasks that only require certain object categories or rooms. The code can be found here: igibson/examples/demo/scene_interactive_partial_loading_example.py.
Visualize Traversability Map¶
In this example, we visuliaze the traversability map of a scene. We use this map to build an internal traversability graph for each floor so that we can compute the shortest path between two locations, and place robots and objects at valid locations inside the scene. The code can be found here: igibson/examples/demo/trav_map_vis_example.py.
The traversability map of the scene
Rs looks like this: